-- Logs begin at Wed 2022-08-24 05:47:43 UTC, end at Wed 2022-08-24 07:04:30 UTC. -- Aug 24 06:31:47.474247 dv-cinder-854270-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 06:31:47.482025 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 06:31:47.484038 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 06:31:47 2022] *** Aug 24 06:31:47.484038 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 06:31:47.484038 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 06:31:47.484038 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: nodename: dv-cinder-854270-1-iscsi Aug 24 06:31:47.484038 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: machine: x86_64 Aug 24 06:31:47.484038 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: clock source: unix Aug 24 06:31:47.484038 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: pcre jit disabled Aug 24 06:31:47.484038 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: detected number of CPU cores: 4 Aug 24 06:31:47.484038 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: current working directory: / Aug 24 06:31:47.484689 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: detected binary path: /usr/bin/uwsgi-core Aug 24 06:31:47.484689 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: your processes number limit is 47680 Aug 24 06:31:47.484689 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: your memory page size is 4096 bytes Aug 24 06:31:47.484689 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: detected max file descriptor number: 2048 Aug 24 06:31:47.484689 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: lock engine: pthread robust mutexes Aug 24 06:31:47.484689 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: thunder lock: enabled Aug 24 06:31:47.484689 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 06:31:47.484689 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 06:31:47.524874 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: Python main interpreter initialized at 0x559295fb49c0 Aug 24 06:31:47.524874 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: python threads support enabled Aug 24 06:31:47.524874 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: your server socket listen backlog is limited to 100 connections Aug 24 06:31:47.524874 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: your mercy for graceful operations on workers is 90 seconds Aug 24 06:31:47.525311 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 06:31:47.525389 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: *** Operational MODE: preforking *** Aug 24 06:31:47.525613 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: *** uWSGI is running in multiple interpreter mode *** Aug 24 06:31:47.525613 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: spawned uWSGI master process (pid: 112691) Aug 24 06:31:47.525816 dv-cinder-854270-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 06:31:47.527217 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: spawned uWSGI worker 1 (pid: 112692, cores: 1) Aug 24 06:31:47.527331 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: spawned uWSGI worker 2 (pid: 112693, cores: 1) Aug 24 06:31:47.527411 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 06:31:48.184779 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:31:48.186281 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:31:49.271320 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:31:49.271320 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: from cryptography.utils import int_from_bytes Aug 24 06:31:49.272110 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:31:49.272110 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: from cryptography.utils import int_from_bytes Aug 24 06:31:49.272535 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:31:49.272535 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: from cryptography.utils import int_from_bytes Aug 24 06:31:49.272660 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:31:49.272660 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: from cryptography.utils import int_from_bytes Aug 24 06:31:51.749075 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:31:51.749682 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:31:51.750042 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:31:51.750140 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:31:51.750237 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:31:51.750327 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:31:51.750414 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:31:51.750500 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:31:51.750575 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:31:51.750652 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:31:51.750834 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.750999 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.751158 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.751321 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.751482 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.751638 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.751798 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.751951 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.752123 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.752275 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.752446 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.752580 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.752741 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.752893 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.753060 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.753226 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.753412 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.753550 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.753673 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.753804 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.753990 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.754114 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.754319 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854270-1-iscsi {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.754415 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854270-1-iscsi {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.754639 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.754737 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.754949 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.755053 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.755261 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.755355 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.755584 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.755723 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.755889 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.756003 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.756208 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.756310 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.756514 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.756609 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.757013 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.757126 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.758231 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.758396 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.758522 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.758621 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.758621 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.758789 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.758876 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.758957 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.759094 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.759442 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.759528 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.759607 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.759740 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.759831 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.759918 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.760011 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.760200 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.760295 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.760511 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.760605 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.760932 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854270-1-iscsi {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.761021 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854270-1-iscsi {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.761271 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.761383 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.761579 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.761665 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.761890 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.761989 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.762293 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.762403 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.762603 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.762689 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.762906 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.762999 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.763221 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.763309 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.763538 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.763624 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.763845 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.763932 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.764166 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.764302 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.764482 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.764570 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.764794 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.764890 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.765107 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.765219 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.765438 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.765525 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.765747 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.765846 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.766047 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.766139 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.766360 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.766462 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.766661 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.766757 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.766961 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.767061 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.767206 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.767303 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.767506 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.767592 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.767823 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.767909 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.768138 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.768239 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.768454 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.768547 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.768701 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.768789 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.768949 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.769049 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.769281 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.769376 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.769600 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.769700 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.769903 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.769997 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.770208 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.770303 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.770505 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.770604 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.770806 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.771094 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.771094 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.771324 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.771413 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.771506 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.771695 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.771783 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.772002 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.772108 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.772316 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.772418 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.772632 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.772731 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.772954 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.773050 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.773783 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.773905 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.774184 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.774291 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.774579 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.774685 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.774830 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.774919 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.775137 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.775230 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.775477 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.775565 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.775794 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.775918 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.776102 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.776202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.776416 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.776513 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.776733 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.776831 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.777037 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.777140 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.777363 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.777461 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.777668 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.777769 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.777982 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.778072 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.778310 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.778410 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.778613 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.778714 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.778861 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.778970 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.779156 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.779325 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.779457 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.779545 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.779770 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.779865 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.780074 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.780172 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.780376 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.780463 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.780677 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.780764 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.780973 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.781068 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.781298 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.781391 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.781603 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.781690 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.781907 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.782011 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.782207 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.782305 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.782508 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.782605 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.782804 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.782898 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.783107 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.783192 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.783413 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.783501 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.783719 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.783820 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.784030 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.784116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.784347 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.784482 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.784651 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.784739 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.784952 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.785037 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.785272 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.785384 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.785578 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.785684 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.785895 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.785993 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.786199 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.786290 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.786502 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.786593 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.786818 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.786913 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.787125 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.787216 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.787432 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.787530 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.787748 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.787845 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.788059 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.788162 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.788360 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.788449 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.788673 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.788769 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.789581 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.789688 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.789889 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.789978 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.790208 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.790380 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.790506 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.790689 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.790787 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.791000 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.791090 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.791309 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.791396 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.791618 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.791707 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.791927 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.792031 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.792238 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.792330 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.792539 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.792634 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.792838 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.792929 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.793138 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.793265 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.793479 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.793576 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.793783 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.793873 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.794086 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.794185 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.794388 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.794478 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.794695 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.794784 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.795015 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:31:51.795115 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.795340 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.795429 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.795669 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.795766 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.795989 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.796082 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.796298 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.796390 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.796625 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.796717 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.796940 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.797031 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.797270 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.797362 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.797583 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.797672 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.797899 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.797998 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.798204 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.798292 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.798511 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.798613 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.798818 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.798909 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.799126 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.799214 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.799437 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.799539 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.799752 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.799860 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.800065 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.800160 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.800381 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.800471 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.800695 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.800801 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.801001 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.801089 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.801335 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.801450 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.801657 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.801761 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.801970 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.802059 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.802289 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.802463 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.802602 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.802692 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.802943 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.803040 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.803286 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.803384 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.803602 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.803689 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.803916 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.804011 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.804226 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.804322 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.804540 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.804641 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.804935 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.805091 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.805330 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.805485 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.805647 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.805733 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.805958 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.806053 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.806278 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.806386 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.806584 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.806680 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.806895 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.806981 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.807198 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.807284 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.807504 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.807596 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.807809 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.807894 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.808118 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.808205 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.808439 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.808532 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.808751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.808858 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.809058 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.809144 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.809394 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.809491 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.809702 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.809804 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.810012 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.810098 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.810323 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.810409 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.810619 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.810717 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.810923 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.811153 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.811270 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.811457 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.811571 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.811766 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.811881 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.812066 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.812186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.812382 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.812504 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.812705 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.812827 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.813008 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.813128 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.813357 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.813482 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.813659 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.813772 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.813967 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.814079 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.814271 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.814399 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.814581 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.814702 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.814937 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.815060 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.815173 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.815292 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.815476 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.815592 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.815778 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.815907 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.816096 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.816221 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.816416 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.816538 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.816701 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.816817 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.817001 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.817127 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.817327 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.817442 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.817629 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.817755 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.817944 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.818058 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.818260 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.818394 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.818571 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.818685 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.818887 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.819009 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.819203 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.819327 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.819527 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.819639 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.819838 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.819952 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.820149 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.820791 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.821004 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.821137 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.821367 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.821483 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.821677 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.821791 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.822005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.822151 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.822333 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.822447 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.822651 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.822958 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.823086 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.823268 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.823403 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.823575 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.823720 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.823881 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.824027 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.824186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.824333 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.824500 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.824639 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.824805 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.824949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.825100 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.825274 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.825425 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.825581 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.825732 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.825888 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.826036 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.826190 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.826360 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.826502 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.826672 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.826829 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.826977 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.827095 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.827280 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.827396 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.827583 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.827703 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.827930 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.828017 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.828240 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.828327 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.828582 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.828676 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.828920 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.829007 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.829263 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.829355 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.829588 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.829676 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.829900 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.829985 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.830207 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.830291 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.830517 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.830606 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.830826 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.830910 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.831134 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.831226 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.831438 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.831523 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.831745 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.831833 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.832056 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.832155 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.832360 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.832452 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.832677 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.832781 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.832984 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.833081 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.833323 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.833424 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.833633 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.833719 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.833934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.834033 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.834236 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.834321 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.834547 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.834634 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.834882 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.834977 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.835201 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.835287 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.835512 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.835596 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.836445 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.836574 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.836781 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.836881 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.837092 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.837215 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.837431 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.837520 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.837744 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.837830 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.838058 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.838155 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.838367 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.838454 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.838673 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.838758 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.838981 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.839066 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.839290 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.839378 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.839594 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.839686 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.839910 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.840006 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.840213 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.840299 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.840517 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.840602 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.840820 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.840913 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.841131 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.841251 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.841478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.841577 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.841788 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.841887 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.842100 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.842186 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.842404 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.842488 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.842717 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.842817 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.843021 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.843116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.843327 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.843420 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.843628 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.843723 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.843926 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.844019 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.844233 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.844319 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.844546 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.844633 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.844858 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.844945 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.845165 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.845346 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.845492 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.845582 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.845791 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.845876 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.846104 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.846189 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.846406 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.846492 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.846707 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.846800 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.847004 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.847089 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.847313 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.847407 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.847621 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.847750 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.847926 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.848011 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.848241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.848336 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.848543 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.848642 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.848844 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.848939 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.849145 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.849273 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.849484 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.849569 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.849788 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.849921 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.850089 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.850175 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.850387 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.850473 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.850694 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.850792 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.851025 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.851119 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.851328 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.851421 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.851676 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.851850 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.852015 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.852150 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.852293 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.852380 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.852610 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.852698 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.852922 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.853010 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.853256 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.853360 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.853580 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.853669 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.853896 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.853982 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.854206 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.854297 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.854515 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.854604 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.854824 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.854911 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.855133 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.855219 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.855438 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.855524 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.855747 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.855841 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.856056 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.856156 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.856363 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.856449 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.856671 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.856763 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.856976 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.857067 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.857299 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.857389 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.857608 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.857705 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.857923 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.858180 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.858486 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.858572 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.858817 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.858902 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.859130 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.859227 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.859447 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.859540 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.859762 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.859846 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.860081 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.860170 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.860404 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.860490 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.860733 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.860818 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.861041 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.861140 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.861378 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.861482 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.861685 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.861770 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.861987 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.862072 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.862287 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.862380 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.862589 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.862681 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.862888 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.862974 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.863188 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.863275 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.863488 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.863581 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.863797 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.863883 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.864096 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.864184 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.864396 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.864480 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.864694 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.864778 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.864995 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.865082 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.865332 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.865422 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.865637 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.865733 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.865935 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.866028 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.866232 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.866317 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.866548 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.866645 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.866847 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.867014 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.867177 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.867323 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.867473 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.867647 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.867792 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.867919 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.868095 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.868181 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.868393 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.868531 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.868725 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.868814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.869051 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.869147 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.869389 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.869490 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.869694 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.869782 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.869991 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.870076 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.870307 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.870394 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.870610 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.870697 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.870906 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.870992 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.871206 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.871294 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.871512 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.871597 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.871812 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.871900 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.872108 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.872236 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.872414 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.872505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.872718 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.872814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.873024 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.873117 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.873348 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.873448 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.873646 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.873745 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.873946 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.874031 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.874241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.874324 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.874549 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.874642 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.874850 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.874936 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.875146 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.875231 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.875439 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.875535 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.875744 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.875832 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.876042 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.876128 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.876336 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.876422 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.876637 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.876721 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.876932 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.877066 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.877261 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.877365 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.877560 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.877646 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.877859 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.877946 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.878154 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.878240 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.878459 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.878552 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.878757 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.878842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.879050 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.879136 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.879366 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.879453 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.879666 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.879750 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.879963 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.880048 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.880262 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.880349 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.880562 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.880656 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.880865 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.880952 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.881174 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.881291 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.881514 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.881612 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.881828 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.881915 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.882128 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.882216 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.882423 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.882518 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.883279 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.883417 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.883590 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.883760 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.884012 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.884105 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.884451 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.884685 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.884772 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.884990 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.885086 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.885323 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.885415 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.885630 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.885768 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.885937 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.886039 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.886241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.886328 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.886561 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.886648 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.886868 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.886969 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.887168 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.887255 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.887467 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.887578 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.887766 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.887862 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.888100 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.888200 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.888398 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.888493 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.888750 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.888837 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.889049 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.889133 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.889381 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.889479 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.889719 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.889815 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.890005 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.890100 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.890311 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.890404 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.890619 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.890706 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.890916 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.891000 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.891228 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.891313 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.891531 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.891622 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.891839 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.891934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.892137 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.892232 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.892434 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.892520 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.892748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.892843 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.893057 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.893152 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.893386 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.893473 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.893704 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.893790 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.894023 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.894121 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.894344 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.894437 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.894643 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.894727 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.894947 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.895047 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.895255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.895343 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.895559 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.895643 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.895861 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.895947 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.896167 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.896253 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.896477 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.896565 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.896788 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.896884 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.897100 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.897205 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.897437 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.897532 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.897749 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.897845 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.898052 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.898146 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.898984 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.899157 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.899360 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.899518 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.899688 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.899781 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.900083 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.900181 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.900392 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.900477 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.900694 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.900779 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.901001 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.901097 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.901329 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.901421 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.901637 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.901734 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.901937 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.902037 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.902366 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.902453 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.902674 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.902766 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.902980 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.903075 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.903283 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.903376 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.903589 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.903676 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.903894 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.903981 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.904204 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.904289 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.904516 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.904601 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.904818 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.904904 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.905254 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.905345 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.905566 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.905653 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.905873 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.905962 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.906182 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.906269 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.906480 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.906565 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.906779 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.906867 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.907086 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.907181 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.907427 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.907526 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.907709 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.907801 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.908004 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.908089 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.908302 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.908398 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.908619 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.908706 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.908921 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.909005 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.909260 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.909361 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.909673 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.909763 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.909981 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.910067 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.910280 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.910380 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.910690 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.910779 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.911001 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.911086 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.911312 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.911399 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.911630 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.911718 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.911949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.912042 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.912268 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.912356 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.912567 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.912674 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.912877 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.912966 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.913201 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.913291 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.913523 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.913612 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.913843 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.913938 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.914186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.914355 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.914525 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.914627 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.914786 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.914884 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.915109 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.915198 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.915436 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.915525 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.915749 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.915836 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.916069 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.916163 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.916483 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.916570 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.916801 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.916903 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.917111 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.917230 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.917458 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.917544 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.917782 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.917870 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.918086 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.918183 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.918408 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.918508 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.918689 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.918777 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.918990 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.919087 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.919290 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.919379 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.919609 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.919695 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.919909 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.920003 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.920216 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.920302 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.920519 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.920606 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.920824 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.920916 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.921124 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.921261 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.921450 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.921537 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.921768 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.921857 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.922069 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.922156 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.922386 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.922473 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.922696 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.922784 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.923010 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.923096 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.923328 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.923424 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.923628 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.923715 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.923946 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.924040 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.924254 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.924386 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.924551 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.924639 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.924852 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.924941 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.925150 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.925268 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.925510 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.925598 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.925810 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.925904 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.926128 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.926224 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.926455 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.926550 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.926777 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.926862 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.927083 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.927172 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.927411 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.927512 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.927736 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.927827 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.928049 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.928144 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.928364 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.928465 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.928684 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.928794 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.928984 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.929073 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.929303 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.929393 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.929654 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.929781 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.929984 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.930168 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.930252 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.930333 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.930556 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.930656 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.930866 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.930962 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.931167 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.931256 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.931472 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.931639 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.931776 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.931864 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.932094 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.932179 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.932394 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.932491 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.932714 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.932801 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.933020 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.933105 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.933345 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.933448 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.933649 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.933736 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.933948 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.934033 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.934286 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.934374 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.934584 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.934677 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.934909 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.934994 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.935213 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.935299 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.935530 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.935617 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.935843 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.935939 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.936156 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.936294 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.936467 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.936556 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.936774 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.936859 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.937085 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.937174 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.937420 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.937520 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.937732 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.937836 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.938036 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.938122 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.938347 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.938435 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.938664 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.938872 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.938967 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.939054 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.939475 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.939561 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.939801 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.939901 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.940112 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.940199 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.940424 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.940509 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.940731 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.940826 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.941043 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.941141 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.941377 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.941465 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.941686 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.941774 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.941993 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.942079 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.942299 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.942391 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.942606 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.942694 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.942926 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.943013 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.943243 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.943331 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.943564 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.943651 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.943893 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.943978 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.944207 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.944303 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.944516 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.944608 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.944825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.944913 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.945663 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.945777 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.946052 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.946211 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.946396 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.946536 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.946655 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.946847 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.946969 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.947163 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.947285 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.947485 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.947614 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.947801 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.947893 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.948112 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.948199 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.948424 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.948522 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.948734 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.948870 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.949043 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.949139 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.949377 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.949469 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.949686 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.949774 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.949993 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.950079 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.950300 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.950387 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.950621 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.950710 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.950940 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.951039 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.951252 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.951341 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.951560 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.951645 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.951872 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.951968 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.952181 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.952389 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.952698 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.952786 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.953018 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.953116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.953366 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.953455 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.953689 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.953777 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.954008 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.954109 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.954322 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.954407 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.954637 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.954725 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.954940 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.955026 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.955242 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.955329 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.955543 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.955629 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.955854 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.955943 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.956156 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.956249 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.956455 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.956550 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.956771 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.956859 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.957075 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.957162 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.957396 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.957482 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.957714 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.957847 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.958018 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.958247 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.958544 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.958647 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.958888 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.958976 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.959203 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.959298 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.959523 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.959619 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.959841 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.959928 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.960147 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.960241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.960447 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.960547 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.960763 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.960921 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.961150 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.961375 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.961501 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.961585 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.961785 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.961874 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.962092 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.962180 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.962399 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.962501 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.962710 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.962800 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.963023 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.963111 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.963329 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.963418 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.963629 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.963714 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.963932 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.964026 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.964233 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.964320 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.964553 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.964652 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.964853 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.964938 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.965156 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.965312 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.965480 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.965578 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.965783 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.965879 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.966083 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.966169 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.966383 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.966470 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.966684 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.966780 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.966982 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.967069 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.967290 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.967377 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.967588 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.967687 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.967889 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.967983 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.968183 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.968276 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.968488 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.968701 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.968792 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.968871 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.969077 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.969229 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.969399 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.969491 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.969713 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.969807 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.970012 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.970098 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.970361 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.970458 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.970674 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.970769 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.970978 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.971065 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.971295 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.971384 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.971605 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.971691 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.971916 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.972008 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.972257 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.972345 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.972570 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.972794 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.973099 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.973219 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.973458 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.973557 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.973777 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.973865 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.974113 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.974213 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.974423 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.974514 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.974730 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.974820 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.975039 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.975136 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.975365 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.975452 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.975678 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.975767 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.975987 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.976081 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.976297 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.976896 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.977154 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.977412 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.977558 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.977647 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.977761 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.977850 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.978075 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.978206 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.978387 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.978477 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.978698 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.978785 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.979007 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.979111 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.979319 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.979429 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.979622 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.979709 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.979933 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.980056 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.980241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.980342 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.980545 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.980633 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.980858 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.980956 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.981202 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.981594 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.981594 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.989564 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.989666 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.989759 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.989861 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.989941 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990035 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990117 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990207 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990288 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990369 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990448 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990527 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990613 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990702 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990783 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990863 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.990946 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991028 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991108 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991196 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991278 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991358 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991438 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991518 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991610 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991693 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991773 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991853 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.991939 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.992039 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.992644 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.992788 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.992949 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993115 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993293 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993382 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993476 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993560 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993646 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993728 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993903 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.993984 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994064 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994143 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994223 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994302 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994391 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994472 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994541 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994628 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994698 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994784 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994873 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994961 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.994961 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995109 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995318 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995418 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995501 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995581 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995661 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995740 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995820 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995908 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.995990 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996069 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996148 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996227 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996307 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996395 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996476 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996556 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996635 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996721 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996803 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996891 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.996971 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997051 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997137 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997252 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997352 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997436 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997517 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997597 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997675 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997755 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997842 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997918 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.997998 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998066 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998144 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998211 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998298 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998432 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998521 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998609 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998609 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998755 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998853 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.998934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999014 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999094 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999174 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999372 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999372 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999605 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999694 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999781 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999861 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:51.999951 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000040 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000122 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000201 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000281 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000366 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000455 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000536 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000623 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000704 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000783 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000862 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.000958 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.001040 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.001120 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.001224 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.001309 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.001402 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.001537 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.001705 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.001848 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.002018 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.002158 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.002331 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.002468 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.002643 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.002781 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.002972 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.003091 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.003303 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.003421 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.003612 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.003750 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.003938 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.004057 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.004257 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.004380 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.004578 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.004695 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.004894 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.005014 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.005221 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.005371 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.005557 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.005679 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.005866 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.006110 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.006204 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.006433 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.006521 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.006742 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.006838 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.007051 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.007139 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.007360 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.007459 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.007693 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.007793 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.008108 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.008271 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.008417 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.008574 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.008709 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.008841 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.009021 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.009448 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.009626 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.009787 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.009952 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.010102 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.010273 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.010430 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.010583 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.010758 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.010905 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.011109 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.011225 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.011425 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.011570 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.011770 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.011867 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.012098 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.012210 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.012415 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.012533 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.012729 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.012850 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.013035 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.013158 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.013320 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:31:52.013479 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:31:52.013719 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:31:52.167026 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO dbcounter [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Registered counter for database nova_api Aug 24 06:31:52.167974 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO dbcounter [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Registered counter for database nova_api Aug 24 06:31:52.188456 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:31:52.189989 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_db.sqlalchemy.engines [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:31:52.195001 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writer thread running {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:31:52.196483 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writer thread running {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:31:52.251894 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.context [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415c196-7046-4f35-a196-e209a2907be2(cell1) {{(pid=112693) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:31:52.252184 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.context [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415c196-7046-4f35-a196-e209a2907be2(cell1) {{(pid=112692) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:31:52.255767 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:52.256090 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_concurrency.lockutils [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:52.256239 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:52.256563 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_concurrency.lockutils [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:52.258436 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:52.258791 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_concurrency.lockutils [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:52.259405 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:52.259842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_concurrency.lockutils [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:52.259939 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:52.260283 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_concurrency.lockutils [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:52.261859 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:52.262286 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_concurrency.lockutils [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:52.263816 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO dbcounter [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Registered counter for database nova_cell0 Aug 24 06:31:52.264222 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO dbcounter [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Registered counter for database nova_cell0 Aug 24 06:31:52.269406 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO dbcounter [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Registered counter for database nova_cell1 Aug 24 06:31:52.269698 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO dbcounter [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Registered counter for database nova_cell1 Aug 24 06:31:52.276473 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:31:52.279322 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_db.sqlalchemy.engines [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:31:52.280495 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_db.sqlalchemy.engines [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:31:52.281571 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:31:52.285101 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writer thread running {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:31:52.285451 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writer thread running {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:31:52.287378 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writer thread running {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:31:52.291494 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writer thread running {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:31:52.432411 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO dbcounter [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Registered counter for database nova_cell0 Aug 24 06:31:52.432748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO dbcounter [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Registered counter for database nova_cell0 Aug 24 06:31:52.441805 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:31:52.444332 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG oslo_db.sqlalchemy.engines [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:31:52.446992 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writer thread running {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:31:52.449368 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writer thread running {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:31:52.947742 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: WARNING keystonemiddleware.auth_token [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:31:52.955029 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: WARNING keystonemiddleware.auth_token [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:31:53.079606 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: WARNING keystonemiddleware.auth_token [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:31:53.087698 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: WARNING keystonemiddleware.auth_token [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:31:53.299350 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: WARNING keystonemiddleware.auth_token [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:31:53.305604 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: WARNING keystonemiddleware.auth_token [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:31:53.311043 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559295fb49c0 pid: 112693 (default app) Aug 24 06:31:53.313329 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:53.314551 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001928 Aug 24 06:31:53.314990 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Wed Aug 24 06:31:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:31:53.431084 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: WARNING keystonemiddleware.auth_token [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:31:53.437037 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: WARNING keystonemiddleware.auth_token [None req-92b082b4-a4b4-4a79-aa96-75a701a4290e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:31:53.442381 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559295fb49c0 pid: 112692 (default app) Aug 24 06:33:14.466472 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:14.467469 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 24 06:33:14.467874 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:33:14.480796 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writing DB stats nova_api:SELECT=3 {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:14.482235 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writing DB stats nova_cell1:SELECT=3 {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:14.483209 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writing DB stats nova_cell0:SELECT=3 {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:14.484078 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:15.351404 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-ef79363f-c87e-4af4-bf86-2cdd2fbf0b0f admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:15.383474 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-ef79363f-c87e-4af4-bf86-2cdd2fbf0b0f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.907702 Aug 24 06:33:15.385222 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1292 bytes} [Wed Aug 24 06:33:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:17.761547 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:17.762550 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-bcdd328c-64d1-4dd8-a113-a0b6d452ed5a None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 06:33:17.762960 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:18.223112 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-564f369b-483f-4dbc-a381-b0f6b0c5994a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:18.245363 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:33:18.245363 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: warnings.warn(msg) Aug 24 06:33:18.330988 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-564f369b-483f-4dbc-a381-b0f6b0c5994a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.561887 Aug 24 06:33:18.331622 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:33:18.548902 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-4fd279dd-4f37-497e-a5b5-2e918a9cd31e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:18.553749 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:33:18.553749 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: warnings.warn(msg) Aug 24 06:33:18.570784 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_api:SELECT=3 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:18.578153 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_cell0:SELECT=3 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:18.578153 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_cell1:SELECT=3 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:18.578153 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:18.699306 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-4fd279dd-4f37-497e-a5b5-2e918a9cd31e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359414 Aug 24 06:33:18.700074 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 24 06:33:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:21.088174 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-564f369b-483f-4dbc-a381-b0f6b0c5994a admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:21.089815 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-564f369b-483f-4dbc-a381-b0f6b0c5994a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Aug 24 06:33:21.090225 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:21.750640 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-6c0c7106-68b0-4c01-b0a2-5340b4bc3d93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:21.772829 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:33:21.772829 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: warnings.warn(msg) Aug 24 06:33:21.945464 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-6c0c7106-68b0-4c01-b0a2-5340b4bc3d93 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.848809 Aug 24 06:33:21.945991 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:33:21.958639 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-398ad9ac-dfbd-4f74-ba98-52814fbc267c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:21.962531 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:33:21.962531 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: warnings.warn(msg) Aug 24 06:33:22.078898 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-398ad9ac-dfbd-4f74-ba98-52814fbc267c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124243 Aug 24 06:33:22.079990 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 24 06:33:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:24.493496 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-6c0c7106-68b0-4c01-b0a2-5340b4bc3d93 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:24.494546 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-6c0c7106-68b0-4c01-b0a2-5340b4bc3d93 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Aug 24 06:33:24.494956 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:24.905956 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-788ef17d-f1a5-438e-b8f3-1482e7dda651 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:24.983300 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-788ef17d-f1a5-438e-b8f3-1482e7dda651 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481913 Aug 24 06:33:24.983783 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:33:24.995846 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-fbb51d76-d2b7-45b9-915a-b95c56cd9f71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:25.094825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-fbb51d76-d2b7-45b9-915a-b95c56cd9f71 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102557 Aug 24 06:33:25.095408 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 24 06:33:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:27.462065 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-788ef17d-f1a5-438e-b8f3-1482e7dda651 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:27.463803 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-788ef17d-f1a5-438e-b8f3-1482e7dda651 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Aug 24 06:33:27.464639 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:27.912544 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-7624b655-0023-4660-b7da-ae991e599f81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:27.991799 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-7624b655-0023-4660-b7da-ae991e599f81 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520630 Aug 24 06:33:27.992472 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:33:28.004704 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-006467aa-674d-42c7-9cb6-e40265d817f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:28.119635 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-006467aa-674d-42c7-9cb6-e40265d817f3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118498 Aug 24 06:33:28.120326 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 24 06:33:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:30.508547 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-7624b655-0023-4660-b7da-ae991e599f81 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:30.509600 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-7624b655-0023-4660-b7da-ae991e599f81 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 24 06:33:30.510014 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:30.942924 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-57e4f497-c6aa-48c9-9f6d-cf3994586f4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:31.035073 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-57e4f497-c6aa-48c9-9f6d-cf3994586f4b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518598 Aug 24 06:33:31.036184 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:33:31.048384 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-d27f38af-4bf8-41ed-9ae8-dc340b6d13d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:31.140840 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-d27f38af-4bf8-41ed-9ae8-dc340b6d13d6 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096135 Aug 24 06:33:31.141898 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1336 bytes} [Wed Aug 24 06:33:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:33.596793 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-57e4f497-c6aa-48c9-9f6d-cf3994586f4b admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:33.597867 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-57e4f497-c6aa-48c9-9f6d-cf3994586f4b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Aug 24 06:33:33.598938 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:33:34.069520 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-29c6dc2c-fa03-4f78-8e66-18fa8279d5ec admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:34.095450 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-29c6dc2c-fa03-4f78-8e66-18fa8279d5ec admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.490010 Aug 24 06:33:34.096027 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1292 bytes} [Wed Aug 24 06:33:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:36.946019 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-57e4f497-c6aa-48c9-9f6d-cf3994586f4b admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:36.947004 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-57e4f497-c6aa-48c9-9f6d-cf3994586f4b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Aug 24 06:33:36.947439 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:37.389464 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-449f2d70-80e8-4565-9427-b5bf37fd4c5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "ram": 512}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:37.463518 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-449f2d70-80e8-4565-9427-b5bf37fd4c5c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.508348 Aug 24 06:33:37.464074 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:33:37.476288 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-51689a62-7d54-4269-820a-c2cae3b998f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:37.607593 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-51689a62-7d54-4269-820a-c2cae3b998f4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135031 Aug 24 06:33:37.608201 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 24 06:33:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:39.967997 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-449f2d70-80e8-4565-9427-b5bf37fd4c5c admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:39.969851 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-449f2d70-80e8-4565-9427-b5bf37fd4c5c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002438 Aug 24 06:33:39.970266 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:40.386568 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-acdc9f7d-1e99-42c8-92c4-e091e9c4f095 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "id": "2"}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:40.451285 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-acdc9f7d-1e99-42c8-92c4-e091e9c4f095 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474493 Aug 24 06:33:40.451854 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:33:40.463823 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-6ef06d55-06ae-40e9-9342-c5e5cd744225 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:40.547145 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-6ef06d55-06ae-40e9-9342-c5e5cd744225 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086880 Aug 24 06:33:40.547737 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 24 06:33:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:42.956207 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-acdc9f7d-1e99-42c8-92c4-e091e9c4f095 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:42.958774 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-acdc9f7d-1e99-42c8-92c4-e091e9c4f095 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002990 Aug 24 06:33:42.959792 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:33:43.478723 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-781f54c8-4277-4ed9-922d-b5393c2cd213 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "id": "3", "ram": 4096, "name": "m1.medium"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:43.544610 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-781f54c8-4277-4ed9-922d-b5393c2cd213 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.572041 Aug 24 06:33:43.545845 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:33:43.557568 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-ce34766c-eafd-449b-b5a1-cf74938897d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:43.668317 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-ce34766c-eafd-449b-b5a1-cf74938897d5 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114331 Aug 24 06:33:43.668926 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 24 06:33:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:46.102583 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-781f54c8-4277-4ed9-922d-b5393c2cd213 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:46.104352 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-781f54c8-4277-4ed9-922d-b5393c2cd213 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Aug 24 06:33:46.104827 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:46.604609 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-dda5341a-cc31-4546-afec-cc21d9f35d41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:46.611474 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:46.753777 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-dda5341a-cc31-4546-afec-cc21d9f35d41 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.642159 Aug 24 06:33:46.754356 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:33:46.768699 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-2d7855e0-6fd1-459b-adca-b73acb88f554 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:46.894900 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-2d7855e0-6fd1-459b-adca-b73acb88f554 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129512 Aug 24 06:33:46.901713 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 24 06:33:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:49.345714 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-dda5341a-cc31-4546-afec-cc21d9f35d41 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:49.346648 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-dda5341a-cc31-4546-afec-cc21d9f35d41 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 24 06:33:49.348178 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:33:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:49.921607 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-5b64e6a4-975d-4eaf-8050-86b04c057d52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "name": "m1.xlarge", "ram": 16384}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:49.928291 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:50.036417 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-5b64e6a4-975d-4eaf-8050-86b04c057d52 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.681552 Aug 24 06:33:50.044437 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1283 bytes} [Wed Aug 24 06:33:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:33:50.055726 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-d9f9efcb-299d-44cf-a974-e7243805466c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:50.154596 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-d9f9efcb-299d-44cf-a974-e7243805466c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108291 Aug 24 06:33:50.155714 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1333 bytes} [Wed Aug 24 06:33:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:10.242289 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-5b64e6a4-975d-4eaf-8050-86b04c057d52 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:10.243253 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-5b64e6a4-975d-4eaf-8050-86b04c057d52 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 24 06:34:10.243658 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:34:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:34:10.749139 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-aec7d14f-6e54-491c-9787-e730fd3d3d7f admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:10.769735 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-aec7d14f-6e54-491c-9787-e730fd3d3d7f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.519005 Aug 24 06:34:10.770318 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1292 bytes} [Wed Aug 24 06:34:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:12.057504 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-5b64e6a4-975d-4eaf-8050-86b04c057d52 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:12.058527 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-5b64e6a4-975d-4eaf-8050-86b04c057d52 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 24 06:34:12.058936 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:34:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:34:12.776170 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-55cfb12d-7205-43f0-8176-d0ee16b8c05e admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:12.783225 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.wsgi [None req-55cfb12d-7205-43f0-8176-d0ee16b8c05e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-55cfb12d-7205-43f0-8176-d0ee16b8c05e admin admin] Request method failure captured: Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Accept: application/json Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Accept-Encoding: gzip, deflate Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Connection: keep-alive Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Content-Length: 0 Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Host: 10.222.0.47 Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Openstack-Api-Version: compute 2.90 Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Openstack-System-Scope: None Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: User-Agent: python-novaclient Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Auth-Token: gAAAAABjBcZjCeqEFYbMhRucxLAK5KrjUT2i9-2hc-vtaSzfRk_ROMyGSpCyp4Q5o_Zn2QpcaHFEnwfQpx_Iem4Krq2bVd6KYMPxCEDVeoZVDTeccLoeGLJ-KPHW7Uu_JX2cBaFFKRzn4s-6NrtFIU2r6pnr65W4TQpfw6mMVAx6_54YkTBh3x8 Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Domain-Id: None Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Domain-Name: None Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Identity-Status: Confirmed Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Is-Admin-Project: True Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Domain-Id: default Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Domain-Name: Default Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Name: admin Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Role: reader,member,admin Aug 24 06:34:12.787478 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Roles: reader,member,admin Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_24c1e9e70e07496595a602ca047e6a1f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Tenant: admin Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Tenant-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Tenant-Name: admin Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User: admin Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Domain-Id: default Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Domain-Name: Default Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Id: 029600e45e6b473db6751098bdba45e2 Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Name: admin Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: method: > Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: exception: Flavor 42 could not be found. Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: action_args: {'id': '42'} Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:34:12.790134 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:12.791748 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.794241 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-55cfb12d-7205-43f0-8176-d0ee16b8c05e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:34:12.796236 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-55cfb12d-7205-43f0-8176-d0ee16b8c05e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.588929 Aug 24 06:34:12.796236 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 24 06:34:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 590 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 06:34:12.802965 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-3fb0e247-870f-47c7-a6a1-22e0726de1f3 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:12.827722 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-3fb0e247-870f-47c7-a6a1-22e0726de1f3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031792 Aug 24 06:34:12.828340 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 24 06:34:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:12.840105 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-6dfd8d81-44bf-4538-a8fb-6d022f3e7d8e admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:12.866003 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-6dfd8d81-44bf-4538-a8fb-6d022f3e7d8e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029814 Aug 24 06:34:12.866595 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 24 06:34:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:12.877387 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b6f02b0d-b0e3-400a-9530-aa6ed8008f96 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:12.888466 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.wsgi [None req-b6f02b0d-b0e3-400a-9530-aa6ed8008f96 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b6f02b0d-b0e3-400a-9530-aa6ed8008f96 admin admin] Request method failure captured: Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Accept: application/json Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Accept-Encoding: gzip, deflate Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Connection: keep-alive Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Content-Length: 0 Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Host: 10.222.0.47 Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Openstack-Api-Version: compute 2.90 Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Openstack-System-Scope: None Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: User-Agent: python-novaclient Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Auth-Token: gAAAAABjBcZjCeqEFYbMhRucxLAK5KrjUT2i9-2hc-vtaSzfRk_ROMyGSpCyp4Q5o_Zn2QpcaHFEnwfQpx_Iem4Krq2bVd6KYMPxCEDVeoZVDTeccLoeGLJ-KPHW7Uu_JX2cBaFFKRzn4s-6NrtFIU2r6pnr65W4TQpfw6mMVAx6_54YkTBh3x8 Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Domain-Id: None Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Domain-Name: None Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Identity-Status: Confirmed Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Is-Admin-Project: True Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Domain-Id: default Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Domain-Name: Default Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Name: admin Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Role: reader,member,admin Aug 24 06:34:12.895116 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Roles: reader,member,admin Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_24c1e9e70e07496595a602ca047e6a1f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Tenant: admin Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Tenant-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Tenant-Name: admin Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User: admin Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Domain-Id: default Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Domain-Name: Default Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Id: 029600e45e6b473db6751098bdba45e2 Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Name: admin Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: method: > Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: exception: Flavor 42 could not be found. Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: action_args: {'id': '42'} Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:34:12.898186 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:12.900010 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:12.902175 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b6f02b0d-b0e3-400a-9530-aa6ed8008f96 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:34:12.904485 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-b6f02b0d-b0e3-400a-9530-aa6ed8008f96 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.023982 Aug 24 06:34:12.904485 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 24 06:34:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:34:14.056884 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-6dfd8d81-44bf-4538-a8fb-6d022f3e7d8e admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:14.057952 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-6dfd8d81-44bf-4538-a8fb-6d022f3e7d8e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 24 06:34:14.058387 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:34:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:34:14.685727 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-107b9829-cf25-4d93-97d2-372d615c9471 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:14.691667 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.wsgi [None req-107b9829-cf25-4d93-97d2-372d615c9471 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-107b9829-cf25-4d93-97d2-372d615c9471 admin admin] Request method failure captured: Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Accept: application/json Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Accept-Encoding: gzip, deflate Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Connection: keep-alive Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Content-Length: 0 Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Host: 10.222.0.47 Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Openstack-Api-Version: compute 2.90 Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Openstack-System-Scope: None Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: User-Agent: python-novaclient Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Auth-Token: gAAAAABjBcZlJ9cO5Kn9F6MZE7EB9RfL2gHv-PoMTSniIeUxWQHm1XYUivcKNOaUFnDgeFjbqiav8kbRSBo3i_iC7sC3IQl5HFYRv5PVd5EwoC2MdZ_wIu3vxcl3oXf2M60GIVuuOJHk5_48fH1-7U0qHQA_M9rPffgZY_6jprvIlL9050zwvRg Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Domain-Id: None Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Domain-Name: None Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Identity-Status: Confirmed Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Is-Admin-Project: True Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Domain-Id: default Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Domain-Name: Default Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Name: admin Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Role: reader,member,admin Aug 24 06:34:14.693267 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Roles: reader,member,admin Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_24c1e9e70e07496595a602ca047e6a1f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Tenant: admin Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Tenant-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Tenant-Name: admin Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User: admin Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Domain-Id: default Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Domain-Name: Default Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Id: 029600e45e6b473db6751098bdba45e2 Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Name: admin Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: method: > Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: exception: Flavor 84 could not be found. Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: action_args: {'id': '84'} Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:34:14.695934 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:14.696814 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.698152 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-107b9829-cf25-4d93-97d2-372d615c9471 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:34:14.699404 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-107b9829-cf25-4d93-97d2-372d615c9471 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.495954 Aug 24 06:34:14.699404 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 24 06:34:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 497 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:34:14.708201 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-6aec1918-0261-4123-9e62-9e15a4b91dc7 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:14.724721 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-6aec1918-0261-4123-9e62-9e15a4b91dc7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021369 Aug 24 06:34:14.725695 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 24 06:34:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:14.740633 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-5e058e2b-db87-4d16-9ecc-93ec4b5802f0 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:14.760443 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-5e058e2b-db87-4d16-9ecc-93ec4b5802f0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023754 Aug 24 06:34:14.764514 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 24 06:34:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:14.778108 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-f4099056-23d0-4dc2-84cc-8e67a2d9a897 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:14.786202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.wsgi [None req-f4099056-23d0-4dc2-84cc-8e67a2d9a897 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-f4099056-23d0-4dc2-84cc-8e67a2d9a897 admin admin] Request method failure captured: Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Accept: application/json Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Accept-Encoding: gzip, deflate Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Connection: keep-alive Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Content-Length: 0 Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Host: 10.222.0.47 Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Openstack-Api-Version: compute 2.90 Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Openstack-System-Scope: None Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: User-Agent: python-novaclient Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Auth-Token: gAAAAABjBcZlJ9cO5Kn9F6MZE7EB9RfL2gHv-PoMTSniIeUxWQHm1XYUivcKNOaUFnDgeFjbqiav8kbRSBo3i_iC7sC3IQl5HFYRv5PVd5EwoC2MdZ_wIu3vxcl3oXf2M60GIVuuOJHk5_48fH1-7U0qHQA_M9rPffgZY_6jprvIlL9050zwvRg Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Domain-Id: None Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Domain-Name: None Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Identity-Status: Confirmed Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Is-Admin-Project: True Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Domain-Id: default Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Domain-Name: Default Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Name: admin Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Role: reader,member,admin Aug 24 06:34:14.787751 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Roles: reader,member,admin Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_24c1e9e70e07496595a602ca047e6a1f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Tenant: admin Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Tenant-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Tenant-Name: admin Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User: admin Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Domain-Id: default Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Domain-Name: Default Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Id: 029600e45e6b473db6751098bdba45e2 Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Name: admin Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: method: > Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: exception: Flavor 84 could not be found. Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: action_args: {'id': '84'} Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:34:14.790202 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:14.791842 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:14.793814 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-f4099056-23d0-4dc2-84cc-8e67a2d9a897 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:34:14.795161 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-f4099056-23d0-4dc2-84cc-8e67a2d9a897 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017117 Aug 24 06:34:14.795161 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Wed Aug 24 06:34:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:34:15.875028 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-5e058e2b-db87-4d16-9ecc-93ec4b5802f0 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:15.876111 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-5e058e2b-db87-4d16-9ecc-93ec4b5802f0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 24 06:34:15.876515 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:34:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:34:16.506096 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-10f92e46-2379-4795-bfba-75f2a32337cb admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:16.512660 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.wsgi [None req-10f92e46-2379-4795-bfba-75f2a32337cb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-10f92e46-2379-4795-bfba-75f2a32337cb admin admin] Request method failure captured: Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Accept: application/json Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Accept-Encoding: gzip, deflate Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Connection: keep-alive Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Content-Length: 0 Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Host: 10.222.0.47 Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Openstack-Api-Version: compute 2.90 Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Openstack-System-Scope: None Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: User-Agent: python-novaclient Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Auth-Token: gAAAAABjBcZn4PdIUt17e9oWGrkp3qAJB3w8R5HwA14Dnr36b5WSMxAUBPELBnn12XygiPG6fo3PmPODiXJybFB-Bjh9koWp6YhNXF9KFQwGszmPeqdPX1O_scz3kbQawKN4hluDHbJciqI5EzCrhDXQjvxLjwiiUcz3IDqSIFiRDcaRWTnudgs Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Domain-Id: None Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Domain-Name: None Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Identity-Status: Confirmed Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Is-Admin-Project: True Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Domain-Id: default Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Domain-Name: Default Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Project-Name: admin Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Role: reader,member,admin Aug 24 06:34:16.514251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Roles: reader,member,admin Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_24c1e9e70e07496595a602ca047e6a1f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Tenant: admin Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Tenant-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-Tenant-Name: admin Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User: admin Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Domain-Id: default Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Domain-Name: Default Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Id: 029600e45e6b473db6751098bdba45e2 Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: X-User-Name: admin Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: method: > Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: exception: Flavor 451 could not be found. Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: action_args: {'id': '451'} Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:34:16.515949 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:16.516919 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.518255 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-10f92e46-2379-4795-bfba-75f2a32337cb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:34:16.520224 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-10f92e46-2379-4795-bfba-75f2a32337cb admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.497850 Aug 24 06:34:16.520224 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 24 06:34:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 499 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:34:16.527167 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-9624d8a1-501c-4c9f-96b5-7bec2c69ec74 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:16.548161 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-9624d8a1-501c-4c9f-96b5-7bec2c69ec74 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024324 Aug 24 06:34:16.549467 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 24 06:34:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:16.563718 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:16.587875 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029088 Aug 24 06:34:16.588464 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Wed Aug 24 06:34:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:16.602278 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-8a75ac75-7c4a-4ef5-9ab8-89b48231db6c admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:16.608308 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.wsgi [None req-8a75ac75-7c4a-4ef5-9ab8-89b48231db6c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-8a75ac75-7c4a-4ef5-9ab8-89b48231db6c admin admin] Request method failure captured: Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Accept: application/json Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Accept-Encoding: gzip, deflate Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Connection: keep-alive Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Content-Length: 0 Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Host: 10.222.0.47 Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Openstack-Api-Version: compute 2.90 Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Openstack-System-Scope: None Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: User-Agent: python-novaclient Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Auth-Token: gAAAAABjBcZn4PdIUt17e9oWGrkp3qAJB3w8R5HwA14Dnr36b5WSMxAUBPELBnn12XygiPG6fo3PmPODiXJybFB-Bjh9koWp6YhNXF9KFQwGszmPeqdPX1O_scz3kbQawKN4hluDHbJciqI5EzCrhDXQjvxLjwiiUcz3IDqSIFiRDcaRWTnudgs Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Domain-Id: None Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Domain-Name: None Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Identity-Status: Confirmed Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Is-Admin-Project: True Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Domain-Id: default Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Domain-Name: Default Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Project-Name: admin Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Role: reader,member,admin Aug 24 06:34:16.613005 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Roles: reader,member,admin Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/24c1e9e70e07496595a602ca047e6a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_24c1e9e70e07496595a602ca047e6a1f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Tenant: admin Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Tenant-Id: 24c1e9e70e07496595a602ca047e6a1f Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-Tenant-Name: admin Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User: admin Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Domain-Id: default Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Domain-Name: Default Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Id: 029600e45e6b473db6751098bdba45e2 Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: X-User-Name: admin Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: method: > Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: exception: Flavor 451 could not be found. Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: action_args: {'id': '451'} Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:34:16.615505 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:16.616825 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: ERROR nova.api.openstack.wsgi Aug 24 06:34:16.619300 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-8a75ac75-7c4a-4ef5-9ab8-89b48231db6c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:34:16.621297 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-8a75ac75-7c4a-4ef5-9ab8-89b48231db6c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012951 Aug 24 06:34:16.621297 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 24 06:34:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 06:34:17.778715 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:17.779730 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 24 06:34:17.780348 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:34:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:34:18.425079 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-3965a057-e904-4117-9ad2-37c956ca07cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:34:18.507991 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-3965a057-e904-4117-9ad2-37c956ca07cd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.575999 Aug 24 06:34:18.508747 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 24 06:34:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:34:19.692406 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:19.693471 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 24 06:34:19.693892 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:34:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:34:20.387565 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-50e17276-a6aa-4d14-a933-9c7a8eac7e82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:34:20.519803 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-50e17276-a6aa-4d14-a933-9c7a8eac7e82 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.680092 Aug 24 06:34:20.520752 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 24 06:34:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:34:21.623412 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:21.624523 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 24 06:34:21.624967 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:34:22.311148 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-f4962639-4c44-4822-b1b6-d6c6ff145998 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:34:22.400947 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-f4962639-4c44-4822-b1b6-d6c6ff145998 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.632109 Aug 24 06:34:22.401557 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 24 06:34:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:34:23.476336 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:23.477393 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 24 06:34:23.477805 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:34:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:34:24.039776 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-7fd8f125-94ee-4c4c-ac31-ca7cf65e6834 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:34:24.117658 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-7fd8f125-94ee-4c4c-ac31-ca7cf65e6834 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.497777 Aug 24 06:34:24.118223 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Wed Aug 24 06:34:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:34:25.278791 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:25.279846 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 24 06:34:25.280265 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:34:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:34:25.837653 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-104f838f-972f-477a-bc35-78f9d116a18e admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:25.859711 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-104f838f-972f-477a-bc35-78f9d116a18e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.439751 Aug 24 06:34:25.860258 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Wed Aug 24 06:34:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:20.412582 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:20.413943 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-dd64bde3-877c-42cd-85ba-5df9e92d7e29 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001815 Aug 24 06:35:20.414381 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 931 bytes} [Wed Aug 24 06:35:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:35:20.427188 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:20.854802 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-f0719695-50aa-42e1-85e1-f3efa1c0e00c admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:20.880661 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-f0719695-50aa-42e1-85e1-f3efa1c0e00c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.457943 Aug 24 06:35:20.881143 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1292 bytes} [Wed Aug 24 06:35:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:20.902377 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG dbcounter [-] [112692] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:20.906944 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-ac7dee10-f0e0-4d2b-b9a3-111b2c66b3cf admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:20.914993 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-ac7dee10-f0e0-4d2b-b9a3-111b2c66b3cf admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014068 Aug 24 06:35:20.917747 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1283 bytes} [Wed Aug 24 06:35:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:20.928592 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-267e43d9-0256-4f96-8d91-c1093f462abd admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:20.936408 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-267e43d9-0256-4f96-8d91-c1093f462abd admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011514 Aug 24 06:35:20.936960 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1286 bytes} [Wed Aug 24 06:35:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:20.950176 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:20.958251 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012033 Aug 24 06:35:20.958815 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1286 bytes} [Wed Aug 24 06:35:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:20.971820 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-96eaf685-6122-42bd-9b14-bc09fbf9afe9 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:20.979727 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-96eaf685-6122-42bd-9b14-bc09fbf9afe9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012449 Aug 24 06:35:20.980290 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1283 bytes} [Wed Aug 24 06:35:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:30.825221 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:30.826476 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001842 Aug 24 06:38:30.827014 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:38:30.973302 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_api:SELECT=6 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:31.170717 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b1784c78-a1dd-4bf8-ba86-9478619672ef admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:31.174458 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:38:31.174458 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: warnings.warn(msg) Aug 24 06:38:31.176623 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b1784c78-a1dd-4bf8-ba86-9478619672ef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:31.176794 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b1784c78-a1dd-4bf8-ba86-9478619672ef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:31.177117 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b1784c78-a1dd-4bf8-ba86-9478619672ef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:31.177862 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b1784c78-a1dd-4bf8-ba86-9478619672ef admin admin] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:31.178309 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b1784c78-a1dd-4bf8-ba86-9478619672ef admin admin] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:31.178722 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b1784c78-a1dd-4bf8-ba86-9478619672ef admin admin] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:31.215278 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-b1784c78-a1dd-4bf8-ba86-9478619672ef admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.243389 Aug 24 06:38:31.216216 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 24 06:38:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:38:32.113882 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:32.114910 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 24 06:38:32.115312 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:38:32.329330 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-b77d768e-4c19-4e98-88f2-871c47cbc6a1 admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:32.333348 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:38:32.333348 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: warnings.warn(msg) Aug 24 06:38:32.335326 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b77d768e-4c19-4e98-88f2-871c47cbc6a1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:32.336088 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b77d768e-4c19-4e98-88f2-871c47cbc6a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:32.336839 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b77d768e-4c19-4e98-88f2-871c47cbc6a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:32.338510 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b77d768e-4c19-4e98-88f2-871c47cbc6a1 admin admin] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:32.340741 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b77d768e-4c19-4e98-88f2-871c47cbc6a1 admin admin] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:32.341567 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-b77d768e-4c19-4e98-88f2-871c47cbc6a1 admin admin] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:32.364873 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-b77d768e-4c19-4e98-88f2-871c47cbc6a1 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.103457 Aug 24 06:38:32.365534 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 24 06:38:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:38:43.815173 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:43.816179 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 24 06:38:43.816579 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:38:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:38:43.973543 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_cell0:SELECT=4 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:43.974273 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_cell1:SELECT=4 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:43.974889 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG dbcounter [-] [112693] Writing DB stats nova_api:SELECT=8 {{(pid=112693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:44.034991 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-ff5c19bf-0c47-4947-b832-d7d481a46d3f admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:44.037381 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:38:44.037381 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: warnings.warn(msg) Aug 24 06:38:44.038507 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-ff5c19bf-0c47-4947-b832-d7d481a46d3f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:44.038981 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-ff5c19bf-0c47-4947-b832-d7d481a46d3f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:44.039401 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-ff5c19bf-0c47-4947-b832-d7d481a46d3f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:44.040710 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-ff5c19bf-0c47-4947-b832-d7d481a46d3f admin admin] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:44.041159 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-ff5c19bf-0c47-4947-b832-d7d481a46d3f admin admin] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:44.041595 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-ff5c19bf-0c47-4947-b832-d7d481a46d3f admin admin] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:44.068567 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-ff5c19bf-0c47-4947-b832-d7d481a46d3f admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.099481 Aug 24 06:38:44.069058 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 24 06:38:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:44.963872 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: DEBUG nova.api.openstack.wsgi [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] Calling method '>' {{(pid=112692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:44.964918 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: INFO nova.api.openstack.requestlog [None req-5e41f1ad-7c7c-4204-aad7-e68b8f019f5b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 24 06:38:44.965357 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: [pid: 112692|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Wed Aug 24 06:38:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:38:45.162778 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG nova.api.openstack.wsgi [None req-760d604a-016d-441d-8d96-8206416596ae admin admin] Calling method '>' {{(pid=112693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:45.165789 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:38:45.165789 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: warnings.warn(msg) Aug 24 06:38:45.167049 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-760d604a-016d-441d-8d96-8206416596ae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:45.167532 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-760d604a-016d-441d-8d96-8206416596ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:45.168180 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-760d604a-016d-441d-8d96-8206416596ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:45.169084 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-760d604a-016d-441d-8d96-8206416596ae admin admin] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:45.169467 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-760d604a-016d-441d-8d96-8206416596ae admin admin] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:45.175830 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: DEBUG oslo_concurrency.lockutils [None req-760d604a-016d-441d-8d96-8206416596ae admin admin] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:45.192032 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: INFO nova.api.openstack.requestlog [None req-760d604a-016d-441d-8d96-8206416596ae admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084597 Aug 24 06:38:45.192621 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: [pid: 112693|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Wed Aug 24 06:38:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:39:42.831405 dv-cinder-854270-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 06:39:42.833734 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: Wed Aug 24 06:39:42 2022 - graceful shutdown triggered... Aug 24 06:39:42.834187 dv-cinder-854270-1-iscsi devstack@n-api.service[112692]: Gracefully killing worker 1 (pid: 112692)... Aug 24 06:39:42.834557 dv-cinder-854270-1-iscsi devstack@n-api.service[112693]: Gracefully killing worker 2 (pid: 112693)... Aug 24 06:39:43.835127 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: worker 1 buried after 1 seconds Aug 24 06:39:43.835127 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: worker 2 buried after 1 seconds Aug 24 06:39:43.835127 dv-cinder-854270-1-iscsi devstack@n-api.service[112691]: goodbye to uWSGI. Aug 24 06:39:43.836699 dv-cinder-854270-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 06:39:43.837458 dv-cinder-854270-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 06:39:43.841450 dv-cinder-854270-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 06:39:43.857161 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 06:39:43 2022] *** Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: nodename: dv-cinder-854270-1-iscsi Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: machine: x86_64 Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: clock source: unix Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: pcre jit disabled Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: detected number of CPU cores: 4 Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: current working directory: / Aug 24 06:39:43.859555 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: detected binary path: /usr/bin/uwsgi-core Aug 24 06:39:43.860232 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: your processes number limit is 47680 Aug 24 06:39:43.860232 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: your memory page size is 4096 bytes Aug 24 06:39:43.860232 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: detected max file descriptor number: 2048 Aug 24 06:39:43.860232 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: lock engine: pthread robust mutexes Aug 24 06:39:43.860232 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: thunder lock: enabled Aug 24 06:39:43.860232 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 06:39:43.860232 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 06:39:43.908882 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: Python main interpreter initialized at 0x564ab24b29c0 Aug 24 06:39:43.908882 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: python threads support enabled Aug 24 06:39:43.908882 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: your server socket listen backlog is limited to 100 connections Aug 24 06:39:43.908882 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: your mercy for graceful operations on workers is 90 seconds Aug 24 06:39:43.909512 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 06:39:43.909512 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: *** Operational MODE: preforking *** Aug 24 06:39:43.909723 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: *** uWSGI is running in multiple interpreter mode *** Aug 24 06:39:43.909723 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: spawned uWSGI master process (pid: 127710) Aug 24 06:39:43.909888 dv-cinder-854270-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 06:39:43.910939 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: spawned uWSGI worker 1 (pid: 127727, cores: 1) Aug 24 06:39:43.910939 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: spawned uWSGI worker 2 (pid: 127728, cores: 1) Aug 24 06:39:43.921425 dv-cinder-854270-1-iscsi devstack@n-api.service[127710]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 06:39:44.643905 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:39:44.687154 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:39:46.176119 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:39:46.176119 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: from cryptography.utils import int_from_bytes Aug 24 06:39:46.177582 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:39:46.177582 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: from cryptography.utils import int_from_bytes Aug 24 06:39:46.178170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:39:46.178170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: from cryptography.utils import int_from_bytes Aug 24 06:39:46.178301 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:39:46.178301 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: from cryptography.utils import int_from_bytes Aug 24 06:39:49.566681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:39:49.569291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:39:49.569291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:39:49.569291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:39:49.569291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:39:49.569291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.573026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.573026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.573026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.573026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.573026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.573026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.573026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.573026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.574999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.574999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.574999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854270-1-iscsi {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.574999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.574999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.574999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.574999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.574999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.576933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.576933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.576933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.576933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.576933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.576933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.578411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.578411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.578411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.578411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.578411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.578411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.580278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.580278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854270-1-iscsi {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.580278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.580887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.580887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.582725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.582725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.584202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.584202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.584681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.584911 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.587496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.587496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.587496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.587496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.589530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.589530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.589530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.591774 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.591774 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.591774 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.592215 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.592840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.593560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.593737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.594258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.597221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.597221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.597221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.597221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.597221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.597221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.599100 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.599340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.602034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.602034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.602034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.602034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.604714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.604714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.604714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.604714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.604714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.605927 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.606362 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.606707 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.607079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.607671 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.608008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.608338 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.608681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.608998 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.609462 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.609860 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.610265 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.611562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.611891 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.612151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.612473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.612796 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.613129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.613476 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.613801 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.614662 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.614976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.615292 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.615612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.615924 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.616290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.616606 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.616916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.617278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.618918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.618918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.618918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.618918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.618918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.619604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.619604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.619889 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.620021 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.620322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.620630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.620957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.622682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.622682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.625029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.625279 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.625612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.626013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.626278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.626608 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.626946 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.627265 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.627586 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.627927 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.628218 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.628531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.628841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.629256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.629613 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.630731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.632201 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.632749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.634003 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.634374 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.634830 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.635242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.635614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.636053 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.636493 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.636840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.637222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.637561 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.638010 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.638520 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.639098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.639646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.640186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.640737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.641334 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.641746 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.642611 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.642796 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.643215 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.643727 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.644291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.644895 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.645056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.645056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.645056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.647645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.647645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.647645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.648262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.648932 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.649224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.649789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.650364 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.650899 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.651506 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.653299 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.653798 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.654342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.654852 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.655079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.655397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.655781 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.656108 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.656475 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.656802 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.657328 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.658644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.658644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.658928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.659396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.659735 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.660029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.660505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.662446 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.662759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.663276 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.663618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.663970 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.664331 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.664675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.665006 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.665373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.665781 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.665993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.666301 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.666624 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.666944 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.667409 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.667747 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.668063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.668380 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.668709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.669028 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.669356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.669836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.670152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.670659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.670984 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.671312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.671648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.671971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.672290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.672799 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.673128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.681037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.681037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.681037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.681037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.681037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.681037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.681037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.681037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.682959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.682959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.682959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.682959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.682959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.682959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.682959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.682959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.684775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.684775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.684775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.684775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.684775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.684775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.684775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.684775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.686725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.686725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.686725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.686725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.686725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.686725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.686725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.686725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.688441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.688441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.688441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.688441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.688441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.688441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.689728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.689728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.689728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.690332 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.690332 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.690783 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.691007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.691323 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.691654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.691972 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.693816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.694104 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.694359 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.694924 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.695176 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.695395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.695642 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.695981 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.696303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.696635 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.697096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.697356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.697638 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.697985 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.698778 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.698778 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.699116 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.699440 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.699752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.700107 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.700418 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.700804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.702138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.702138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.702138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.702855 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.702855 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.703538 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.703538 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.703994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.704231 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.704500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.704895 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.705301 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.705490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.705820 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.706133 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.706446 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.706779 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.707096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.707408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.709559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.709799 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.710204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.710460 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.710692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.711008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.711545 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.711993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.712276 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.712500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.712816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.713213 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.724896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.724896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.724896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.724896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.724896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.724896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.724896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.724896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.727220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.727220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.727220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.727220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.727220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.727220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.727220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.727220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.729239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.729239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.729239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.729239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.729239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.729239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.729239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.729239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.731372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.731372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.731372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.731372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.731372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.731372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.731372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.731372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.733519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.733519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.733519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.733519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.733519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.733519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.733519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.733519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.735379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.735379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.735379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.735379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.735379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.735379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.735379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.735379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.737366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.737366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.737366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.737366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.737366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.737366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.737366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.737366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.738656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.738656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.738656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.738656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.738656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.738656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.738656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.738656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.739753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.739753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.739753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.739753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.739753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.739753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.739753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.739753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.741610 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.741610 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.741610 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.741610 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.741610 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.742463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.742463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.742841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.743053 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.743366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.743734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.744043 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.745389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.745389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.745389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.745389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.746031 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.746031 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.746558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.746558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.747014 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.747226 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.747539 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.747849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.748165 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.748480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.749048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.749270 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.749468 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.749727 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.750066 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.750466 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.750676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.752022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.752022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.752022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.752022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.752808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.752808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.753159 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.754290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.754290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.755363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.755648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.756472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.756733 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.756969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.757643 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.757892 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.758169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.758424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.758734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.759059 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.759391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.759724 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.760059 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.760556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.760787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.761255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.761469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.761696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.761949 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.762268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.762588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.762908 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.763751 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.764078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.765126 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.765461 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.765784 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.766426 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.766426 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.766959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.767168 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.767371 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.767739 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.768005 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.768326 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.768780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.769101 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.769450 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.769765 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.771173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.771817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.772978 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.772978 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.772978 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.773634 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.773634 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.774003 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.774179 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.774480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.774952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.775201 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.775418 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.775764 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.777252 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.777914 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.778279 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.778609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.778950 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.779402 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.779734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.780051 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.780483 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.780808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.781132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.781499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.781832 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.782181 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.782701 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.783031 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.783354 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.783696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.784032 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.784358 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.784688 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.785076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.785346 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.785680 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.787684 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.788020 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.788472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.788816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.789142 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.789512 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.790003 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.790222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.790463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.790782 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.791100 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.791440 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.791749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.792062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.792450 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.792776 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.793095 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.793474 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.793784 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.794427 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.794427 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.794933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.795185 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.795416 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.795709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.796020 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.796355 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.796673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.796981 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.797330 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.797640 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.797994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.798313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.798640 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.799036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.799376 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.799692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.800184 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.800397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.800679 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.801005 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.801385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.804393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.804393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.804393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.804393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.804393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.804393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.808312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.808312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.808312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.808312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.808312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.808312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.808312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.808312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.813804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.813804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.813804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.813804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.813804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.813804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.813804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.813804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.814968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:39:49.814968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:39:49.815553 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.815553 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.815853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:39:49.815999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.816138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:39:49.816138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:39:49.816380 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.816380 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.816629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.816762 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.816885 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.817280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.817437 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.817576 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.817709 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.817853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.818222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.818390 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.818557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.819302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.819511 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.819710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.819908 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.820105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.820320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.820320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.820320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.820320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854270-1-iscsi {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.821014 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.821318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.821523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.821673 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.822040 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.822040 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.822438 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.822644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.822841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.823043 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.823043 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.823411 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.823602 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.823602 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.823997 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.824201 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.824201 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.824571 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.824783 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.824783 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.824783 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.825410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.825644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.825644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.826048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.826202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.826416 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.826638 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.826799 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.826968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.826968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.827266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.827421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.827421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.827715 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.827951 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.827951 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.828284 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.828448 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.828627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.828793 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.828793 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.829151 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.829346 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.829482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.829683 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.829683 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.830081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.830284 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.830483 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.830672 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854270-1-iscsi {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.830933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.831128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.831317 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.831505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.831698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.831887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.831887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.832450 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.832676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.832676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.833064 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.833339 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.833770 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.834540 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.834756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.834949 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.834949 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.835345 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.835537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.835730 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.835919 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.836135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.836337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.836631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.836843 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.837036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.837352 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.838176 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.838415 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.838647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.838647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.839056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.839279 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.839478 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.839690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.839690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.840060 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.840259 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.840462 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.840662 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.840662 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.841032 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.841263 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.841263 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.841643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.841833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.841833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.842503 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.842712 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.842902 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.843088 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.843088 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.843453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.843667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.843667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.844091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.844289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.844289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.844664 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.844866 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.844866 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.845247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.845436 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.845436 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.845830 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.846018 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.846018 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.846373 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.846577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.846782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.846974 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.846974 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.847336 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.847528 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.847528 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.847949 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.848154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.848154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.849043 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.849342 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.849839 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.850056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.850258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.850418 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.850574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.850864 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.851044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.851219 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.851408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.851569 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.851824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.852092 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.852247 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.852457 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.852672 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.852954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.853128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.853510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.854496 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.854723 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.854939 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.855094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.855693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.856159 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.856541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.856754 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.856950 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.857155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.857629 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.857849 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.858042 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.858375 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.858832 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.859336 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.859522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.859714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.859892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.860385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.860540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.860712 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.860955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.861450 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.861683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.861846 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.862116 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.862359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.862588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.862809 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.862986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.863150 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.863375 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.863533 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.863733 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.864605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.864814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.864987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.865215 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.865773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.866202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.866622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.867034 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.867204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.867574 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.867762 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.867915 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.868190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.868434 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.868644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.868803 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.868976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.869616 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.872069 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.872305 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.872508 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.872508 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.872894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.873125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.873125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.873531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.873677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.873833 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.873971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.873971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.874464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.874732 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.874732 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.875241 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.875678 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.875678 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.875678 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.875678 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.876600 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.876874 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.877110 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.877462 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.877462 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.877930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.878192 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.878192 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.878655 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.878902 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.878902 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.879349 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.880135 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.880380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.880621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.880621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.881065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.881337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.881337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.881840 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.882073 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.882073 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.882542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.882787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.883025 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.883269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.883269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.883747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.883990 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.884227 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.884478 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.884478 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.884955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.885212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.885465 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.885725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.885725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.886407 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.886657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.886893 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.887126 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.887126 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.887581 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.887836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.887836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.888283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.888519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.888519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.888979 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.889237 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.889503 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.889738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.889738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.890160 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.890386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.890386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.890887 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.891122 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.891358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.891358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.891817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.891817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.892288 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.892511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.892511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.892937 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.893155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.893155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.893717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.893969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.893969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.894413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.894646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.894646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.894953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.895155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.895831 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.895986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.895986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.896326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.896481 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.896633 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.896633 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.896940 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.896940 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.897292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.897446 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.897588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.897720 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.897851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:39:49.898059 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.898059 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.898059 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.898594 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.898794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.899007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.899007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.899376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.899562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.899562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.899954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.900254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.900472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.900682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.900871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.901074 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.901354 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.901619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.901853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.902091 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.902337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.902570 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.902824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.902824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.903287 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.903522 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.903522 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.903994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.904252 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.904506 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.904739 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.904739 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.905240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.905482 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.905734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.905968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.905968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.906430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.906675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.906675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.907132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.907374 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.907374 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.907749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.907904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.907904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.908191 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.908328 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:39:49.908467 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.909920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.910450 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.910930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.911409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.911919 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.912403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.912866 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.914088 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.914422 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.914892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.915367 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.915838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.916297 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.916759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.918464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.918464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.918988 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.919446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.920030 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.920504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.920969 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.921549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.922052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.922787 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.922911 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.923510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.923888 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.924257 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.924793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.925148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.927357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.927679 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.928016 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.928338 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.928665 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.928997 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.929875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.930235 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.930578 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.930897 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.931250 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.931560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.931880 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.932486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.932486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.932912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.933157 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.934388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.934388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.934388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.934935 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.934935 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.935296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.935477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.935694 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.936040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.936357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.937292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.937292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.937803 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.938141 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.938461 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.938783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.939120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.939462 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.939770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.940925 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.940925 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.940925 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.941618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.941618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.941618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.942686 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.942874 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.943103 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.943360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.943669 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.943972 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.944305 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.945104 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.945104 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.945562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.945759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.946109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.946343 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.946756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.947133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.948057 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.948057 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.948937 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.949330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.949691 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.950028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.950394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.950717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.951035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.951357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.951745 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.952110 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.952453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.952833 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.954079 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.954327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.954642 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.955165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.955527 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.955904 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.956273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.956633 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.957107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.957478 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.958578 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.958791 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.959137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.959475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.959809 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.960164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.960497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.960837 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.961157 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.961527 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.962634 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.963000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.963343 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.963673 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.964068 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.964899 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.964899 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.965438 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.965680 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.966007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.966436 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.966642 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.966964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.967282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.967603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.967931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.968286 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.968766 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.969009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.969778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.970149 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.970472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.970823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.971189 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.971531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.973397 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.973677 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.974033 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.974394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.974715 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.975078 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.975550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.975896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.976218 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.976658 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.976913 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.977171 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO dbcounter [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Registered counter for database nova_api Aug 24 06:39:49.977527 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.977768 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.977952 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.978599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.978599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.981472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.981472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.981472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.981472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.981472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.981472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.981472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.981472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.984222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.984222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.984222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.984222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.984222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.984222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.985565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.985565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.985565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.987099 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.987468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.987809 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.988152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.988492 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.988829 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.989905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.990076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.990476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.991325 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.991653 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.991997 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.992516 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.998910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.998910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.998910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.998910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.998910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.998910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.998910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:49.998910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.000039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.000039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.000039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.000039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.000416 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.001218 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.001738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.002268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.002866 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.004266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.004624 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_db.sqlalchemy.engines [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:39:50.006198 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.006825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.007490 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.008018 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.008685 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.009224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.009850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.010334 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.010953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.011494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.012054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.012620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.013107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.013375 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writer thread running {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:39:50.014227 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.014568 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.014898 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.015230 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.015558 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.015875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.016249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.016748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.017384 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.017877 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.018430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.018989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.019466 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.019986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.020603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.021220 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.021646 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.022164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.022755 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.023259 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.023841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.024244 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.024783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.025312 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.025774 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.026355 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.026841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.027418 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.027962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.028511 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.029067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.029690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.030295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.030850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.031444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.031979 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.032483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.033041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.033641 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.034618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.034618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.035059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.035571 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.035999 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.036324 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.036758 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.037415 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.037984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.038529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.039180 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.039616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.040185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.040767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.041400 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.041940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.042690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.043309 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.043531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.043919 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.044511 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.045049 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.045541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.045981 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.046309 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.047096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.047352 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.047690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.048243 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.048825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.049411 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.049995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.051063 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.051063 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.052381 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.052381 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.052841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.053261 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.053744 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.054427 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.054807 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.055368 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.055948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.056506 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.057047 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.057646 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.058150 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.058662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.059199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.059720 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.060231 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.061086 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.061391 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.061728 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.062393 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.062930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.063505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.064019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.064878 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.065208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.065776 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.066377 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.066879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.068143 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.068755 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.069711 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.069908 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.070432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.071013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.071561 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.072192 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.072682 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.073311 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.073795 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.074143 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.074586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.075183 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.075867 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.076207 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.076540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.077356 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.077828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.078464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.078933 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.079553 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.080065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.080272 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.context [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415c196-7046-4f35-a196-e209a2907be2(cell1) {{(pid=127728) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:39:50.080618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.081284 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.081815 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.082346 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.082976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.083520 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.083919 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.084925 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.085043 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.085491 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.085863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.086148 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:50.086356 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.086655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:50.087180 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.087721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.088422 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.088537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:50.088861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.089146 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:50.089416 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.089628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:50.089917 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.090466 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.091014 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.091468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.091664 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:50.092015 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.092565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.093091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.094335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO dbcounter [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Registered counter for database nova_cell0 Aug 24 06:39:50.094498 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.094877 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.095481 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.096050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.098050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.098050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.098050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.099213 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.099213 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.099549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.100155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.100349 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO dbcounter [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Registered counter for database nova_cell1 Aug 24 06:39:50.100531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.100726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.101251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.102055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.104120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.104120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.105502 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.105926 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.106207 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.106572 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.106928 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.107264 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.107872 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.108267 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.108548 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.108885 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.110143 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_db.sqlalchemy.engines [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:39:50.110709 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.110998 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_db.sqlalchemy.engines [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:39:50.112003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.112470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.112823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.113479 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.114365 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.114571 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.114906 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.115954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.116494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.117035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.117914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.118738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.119596 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.120239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.120885 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.121675 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.121784 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writer thread running {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:39:50.121875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.122289 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.122871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.122871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.123643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.123643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.124436 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.124436 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.124779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.124898 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writer thread running {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:39:50.125021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.125747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.126269 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.127013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.130124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.130124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.130124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.130124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.131510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.132317 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.135707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.135707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.135707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.135707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.135707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.135707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.136578 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.136578 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.136912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.139808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.139808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.139808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.139808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.139808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.140666 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.140871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.141414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.142055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.146432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.146432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.146432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.146432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.146432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.146432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.146432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.147984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.147984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.147984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.148443 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.148721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.151905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.151905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.151905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.151905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.151905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.151905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.152914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.152914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.153246 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.154256 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.154256 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.154590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.154590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.155019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.155704 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.156243 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.156777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.157526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.158329 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.159454 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.162342 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.164802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.164802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.164802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.164802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.164802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.164802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.172247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.172247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.172247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.172247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.172247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.172247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.172247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.172247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.173995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.173995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.173995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.173995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.173995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.173995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.173995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.173995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.175272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.175272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.175272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.175272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.175272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.175272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.175272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.175272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.176258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.176258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.176258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.176258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.176258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.176258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.176258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.176258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.178055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.178055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.178055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.178055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.178910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.178910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.178910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.179442 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.179442 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.179808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.180129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.180457 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.181054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.181694 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.182055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.182254 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.182470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.182809 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.183234 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.183452 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.183814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.184130 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.184479 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.184838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.185159 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.186155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.186481 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.186805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.187135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.187451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.187772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.188093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.188410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.188757 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.189159 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.191390 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.193482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.193482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.193482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.193482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.194360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.194360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.194713 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.194852 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.195167 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.195507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.195849 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.196300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.196494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.196950 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.197716 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.197716 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.198008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.198531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.199610 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.199610 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.199905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.200035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.200361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.200721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.201071 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.201465 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.201814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.202123 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.202437 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.202776 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.203092 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.203469 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.203732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.204045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.204353 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.204675 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.206695 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.207059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.207406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.207897 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.208403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.208725 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.209079 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.209606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.209829 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.210038 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.212490 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.212851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.213206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.213533 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.214296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.214296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.214706 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.217204 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.217959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.217959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.218266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.218620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.218962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.219351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.219916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.220514 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.221347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.221758 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.222282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.222732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.223493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.223772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.224206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.224602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.224978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.225540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.226374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.226687 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.227106 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.227915 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.228668 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.229501 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.230282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.230854 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.231419 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.231910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.232627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.233526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.233526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.233900 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.234104 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.234369 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.234875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.235222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.235845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.236453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.236992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.237600 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.238123 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.238773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.239844 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.240497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.241012 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.241606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.242455 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.243085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:39:50.243486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:39:50.301270 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO dbcounter [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Registered counter for database nova_cell0 Aug 24 06:39:50.312493 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_db.sqlalchemy.engines [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:39:50.320265 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writer thread running {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:39:50.329255 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO dbcounter [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Registered counter for database nova_api Aug 24 06:39:50.354136 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_db.sqlalchemy.engines [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:39:50.365583 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writer thread running {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:39:50.429770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.context [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c415c196-7046-4f35-a196-e209a2907be2(cell1) {{(pid=127727) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:39:50.434596 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:50.435096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:50.436736 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:50.437551 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:50.437993 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:50.440079 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:50.442339 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO dbcounter [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Registered counter for database nova_cell0 Aug 24 06:39:50.446948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO dbcounter [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Registered counter for database nova_cell1 Aug 24 06:39:50.455698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_db.sqlalchemy.engines [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:39:50.459532 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_db.sqlalchemy.engines [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:39:50.466372 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writer thread running {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:39:50.469536 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writer thread running {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:39:50.631229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO dbcounter [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Registered counter for database nova_cell0 Aug 24 06:39:50.639736 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_db.sqlalchemy.engines [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:39:50.652676 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writer thread running {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:39:50.823912 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: WARNING keystonemiddleware.auth_token [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:39:50.832275 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: WARNING keystonemiddleware.auth_token [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:39:51.026487 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: WARNING keystonemiddleware.auth_token [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:39:51.034769 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: WARNING keystonemiddleware.auth_token [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:39:51.348991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: WARNING keystonemiddleware.auth_token [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:39:51.355393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: WARNING keystonemiddleware.auth_token [None req-7dad0688-b5c7-426d-9172-4bf43bd2497d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:39:51.361847 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x564ab24b29c0 pid: 127728 (default app) Aug 24 06:39:51.410483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: WARNING keystonemiddleware.auth_token [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:39:51.417341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: WARNING keystonemiddleware.auth_token [None req-e89c09ff-e430-43ba-91ed-aced6ef70a59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:39:51.422878 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x564ab24b29c0 pid: 127727 (default app) Aug 24 06:40:28.775134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:28.776134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:28.776918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:28.777705 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:29.249922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=3 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:29.250759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=3 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:29.254500 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=3 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:29.254500 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=3 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:30.374579 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e0976c22-a20b-4a88-a246-dffb94e379f7 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Action: 'create', calling method: .version_select at 0x7fb5d655b5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-799817247", "metadata": {"Type": "work"}}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e0976c22-a20b-4a88-a246-dffb94e379f7 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Request method failure captured: Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 121 Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfcR2opTx5cyy1F7x_-1joh7evYqXEedX-QjlHA2C08Ap5Q9JzgsrS1rVdRKDtf1f8roRpujR8HyxMpB0rfWQQc_UH8tQvSsyWOGxFntYsH7eatYp9zVXjpWemcPu8KP8fFvCiolG7l-rWdu65BhyL0lO5SR2fakeeOwz6tlORcAE8 Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:40:30.390655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_738113e0ae1c4cfa942acc615e748a9b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: a4fddb5f283940838ab1e60ec8c64a9c Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-799817247", "metadata": {"Type": "work"}}} Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: Aug 24 06:40:30.393232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-799817247', 'metadata': {'Type': 'work'}}}} Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise error Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:40:30.394563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 06:40:30.396491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 06:40:30.411829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 06:40:30.411829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.411829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e0976c22-a20b-4a88-a246-dffb94e379f7 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:40:30.411829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e0976c22-a20b-4a88-a246-dffb94e379f7 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.641168 Aug 24 06:40:30.411829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 24 06:40:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1651 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:40:30.419113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d6af2f02-c384-4e75-a836-93c4805c0649 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Action: 'create', calling method: .version_select at 0x7fb5d655b670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-591117036", "metadata": {"Type": "work"}}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d6af2f02-c384-4e75-a836-93c4805c0649 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Request method failure captured: Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 119 Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfcR2opTx5cyy1F7x_-1joh7evYqXEedX-QjlHA2C08Ap5Q9JzgsrS1rVdRKDtf1f8roRpujR8HyxMpB0rfWQQc_UH8tQvSsyWOGxFntYsH7eatYp9zVXjpWemcPu8KP8fFvCiolG7l-rWdu65BhyL0lO5SR2fakeeOwz6tlORcAE8 Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:40:30.425983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_738113e0ae1c4cfa942acc615e748a9b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: a4fddb5f283940838ab1e60ec8c64a9c Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-591117036", "metadata": {"Type": "work"}}} Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: Aug 24 06:40:30.427667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-591117036', 'metadata': {'Type': 'work'}}}} Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise error Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi '0' Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:40:30.428621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 06:40:30.430497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 06:40:30.432063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 06:40:30.432063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.434471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d6af2f02-c384-4e75-a836-93c4805c0649 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:40:30.436612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d6af2f02-c384-4e75-a836-93c4805c0649 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025703 Aug 24 06:40:30.441264 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 2/2] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 24 06:40:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:40:30.465428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d3b92e91-740c-4484-b88a-e36b033a18d3 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Action: 'create', calling method: .version_select at 0x7fb5d64941f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-333026823", "metadata": {"Type": "work"}}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d3b92e91-740c-4484-b88a-e36b033a18d3 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Request method failure captured: Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 118 Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfcR2opTx5cyy1F7x_-1joh7evYqXEedX-QjlHA2C08Ap5Q9JzgsrS1rVdRKDtf1f8roRpujR8HyxMpB0rfWQQc_UH8tQvSsyWOGxFntYsH7eatYp9zVXjpWemcPu8KP8fFvCiolG7l-rWdu65BhyL0lO5SR2fakeeOwz6tlORcAE8 Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:40:30.469173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_738113e0ae1c4cfa942acc615e748a9b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: a4fddb5f283940838ab1e60ec8c64a9c Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-333026823", "metadata": {"Type": "work"}}} Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: Aug 24 06:40:30.471196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-333026823', 'metadata': {'Type': 'work'}}}} Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise error Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi '' Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:40:30.471969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 06:40:30.473383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 06:40:30.474710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 06:40:30.474710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:30.474710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d3b92e91-740c-4484-b88a-e36b033a18d3 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:40:30.478490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d3b92e91-740c-4484-b88a-e36b033a18d3 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028799 Aug 24 06:40:30.482203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 3/3] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 24 06:40:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:40:30.494560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4bb533bb-d702-460b-a246-397f99bc1205 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Calling method '.version_select at 0x7fb5d6494b80>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:30.725628 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5efef738-bd53-4f51-ae8f-5ab38cee105a tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Action: 'create', calling method: .version_select at 0x7fb5d655c8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-423061217", "metadata": {"Type": "work"}}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:31.348006 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-4bb533bb-d702-460b-a246-397f99bc1205 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] HTTP exception thrown: Volume tempest-invalid-325703743 could not be found. Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4bb533bb-d702-460b-a246-397f99bc1205 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Request method failure captured: Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-325703743 HTTP/1.1 Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfcR2opTx5cyy1F7x_-1joh7evYqXEedX-QjlHA2C08Ap5Q9JzgsrS1rVdRKDtf1f8roRpujR8HyxMpB0rfWQQc_UH8tQvSsyWOGxFntYsH7eatYp9zVXjpWemcPu8KP8fFvCiolG7l-rWdu65BhyL0lO5SR2fakeeOwz6tlORcAE8 Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:40:31.353034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_738113e0ae1c4cfa942acc615e748a9b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: a4fddb5f283940838ab1e60ec8c64a9c Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Volume tempest-invalid-325703743 could not be found. Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'tempest-invalid-325703743'} Aug 24 06:40:31.354381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-325703743 could not be found. (HTTP 404) (Request-ID: req-2db0fe10-48c9-47d2-81ae-078fbcb08c5f) Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:31.355628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:40:31.359038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-325703743 could not be found. Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:40:31.361676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-325703743 could not be found. Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-325703743 could not be found. Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4bb533bb-d702-460b-a246-397f99bc1205 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Returning 404 to user: Volume tempest-invalid-325703743 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4bb533bb-d702-460b-a246-397f99bc1205 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-325703743" status: 404 len: 98 microversion: 2.1 time: 0.865350 Aug 24 06:40:31.364361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 4/4] 10.222.0.47 () {58 vars in 1215 bytes} [Wed Aug 24 06:40:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-325703743 => generated 98 bytes in 867 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 06:40:31.367935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e6c691e4-9359-4bce-97a6-fb00a130583a tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006134 Aug 24 06:40:31.369563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 5/5] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Aug 24 06:40:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 06:40:31.377738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d87a0cee-6cb9-4e71-91f9-f5034085bdc2 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004019 Aug 24 06:40:31.381433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 6/6] 10.222.0.47 () {58 vars in 1137 bytes} [Wed Aug 24 06:40:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 06:40:31.391981 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6386985f-7eb0-4a39-982f-12ae6dc987e2 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Calling method '.version_select at 0x7fb5d63ca550>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-6386985f-7eb0-4a39-982f-12ae6dc987e2 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] HTTP exception thrown: Volume d11ee784-6443-42ca-bdf1-ce994a663fb2 could not be found. Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6386985f-7eb0-4a39-982f-12ae6dc987e2 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Request method failure captured: Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/os-volumes/d11ee784-6443-42ca-bdf1-ce994a663fb2 HTTP/1.1 Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfcR2opTx5cyy1F7x_-1joh7evYqXEedX-QjlHA2C08Ap5Q9JzgsrS1rVdRKDtf1f8roRpujR8HyxMpB0rfWQQc_UH8tQvSsyWOGxFntYsH7eatYp9zVXjpWemcPu8KP8fFvCiolG7l-rWdu65BhyL0lO5SR2fakeeOwz6tlORcAE8 Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:40:32.123916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_738113e0ae1c4cfa942acc615e748a9b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: a4fddb5f283940838ab1e60ec8c64a9c Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Volume d11ee784-6443-42ca-bdf1-ce994a663fb2 could not be found. Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'd11ee784-6443-42ca-bdf1-ce994a663fb2'} Aug 24 06:40:32.140499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d11ee784-6443-42ca-bdf1-ce994a663fb2 could not be found. (HTTP 404) (Request-ID: req-5d2a7e3e-ad2e-4a3e-b0a5-8f49ccc07c21) Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:32.150901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:40:32.160756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d11ee784-6443-42ca-bdf1-ce994a663fb2 could not be found. Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 06:40:32.166297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d11ee784-6443-42ca-bdf1-ce994a663fb2 could not be found. Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d11ee784-6443-42ca-bdf1-ce994a663fb2 could not be found. Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6386985f-7eb0-4a39-982f-12ae6dc987e2 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Returning 404 to user: Volume d11ee784-6443-42ca-bdf1-ce994a663fb2 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6386985f-7eb0-4a39-982f-12ae6dc987e2 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/d11ee784-6443-42ca-bdf1-ce994a663fb2" status: 404 len: 109 microversion: 2.1 time: 0.243432 Aug 24 06:40:32.168112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 7/7] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:40:31 2022] DELETE /compute/v2.1/os-volumes/d11ee784-6443-42ca-bdf1-ce994a663fb2 => generated 109 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:40:32.171041 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-227eb15d-ef83-44f8-b583-cc61ec55db89 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Calling method '.version_select at 0x7fb5d63ca820>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:33.310090 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-227eb15d-ef83-44f8-b583-cc61ec55db89 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] HTTP exception thrown: Volume 5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9 could not be found. Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-227eb15d-ef83-44f8-b583-cc61ec55db89 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Request method failure captured: Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/os-volumes/5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9 HTTP/1.1 Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfcR2opTx5cyy1F7x_-1joh7evYqXEedX-QjlHA2C08Ap5Q9JzgsrS1rVdRKDtf1f8roRpujR8HyxMpB0rfWQQc_UH8tQvSsyWOGxFntYsH7eatYp9zVXjpWemcPu8KP8fFvCiolG7l-rWdu65BhyL0lO5SR2fakeeOwz6tlORcAE8 Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:40:33.313361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/738113e0ae1c4cfa942acc615e748a9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_738113e0ae1c4cfa942acc615e748a9b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 738113e0ae1c4cfa942acc615e748a9b Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesNegativeTest-1830754130 Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: a4fddb5f283940838ab1e60ec8c64a9c Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesNegativeTest-1830754130-project Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Volume 5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9 could not be found. Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9'} Aug 24 06:40:33.315145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9 could not be found. (HTTP 404) (Request-ID: req-e7249c88-4682-49f5-987b-68cc3c7afa8a) Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:33.315856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:40:33.317305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9 could not be found. Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:40:33.318550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9 could not be found. Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9 could not be found. Aug 24 06:40:33.319547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:33.322436 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-227eb15d-ef83-44f8-b583-cc61ec55db89 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] Returning 404 to user: Volume 5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:40:33.323360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-227eb15d-ef83-44f8-b583-cc61ec55db89 tempest-VolumesNegativeTest-1830754130 tempest-VolumesNegativeTest-1830754130-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9" status: 404 len: 109 microversion: 2.1 time: 1.684471 Aug 24 06:40:33.331921 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 8/8] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:40:31 2022] GET /compute/v2.1/os-volumes/5db9c746-9b1f-42c8-a0e3-ac6307c3ddb9 => generated 109 bytes in 1686 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:40:33.464273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5efef738-bd53-4f51-ae8f-5ab38cee105a tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.223135 Aug 24 06:40:33.465601 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 1/9] 10.222.0.47 () {60 vars in 1156 bytes} [Wed Aug 24 06:40:29 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4226 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 06:40:33.481765 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d90544fe-e59b-4388-8ae6-61195eeb52af tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Calling method '.version_select at 0x7fb5d6494ee0>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:33.580883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d90544fe-e59b-4388-8ae6-61195eeb52af tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088" status: 200 len: 352 microversion: 2.1 time: 0.104311 Aug 24 06:40:33.581997 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 9/10] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:40:33 2022] GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:40:34.598278 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ddd7a5fa-fb1c-4f91-b1ca-88be2025f8d8 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Calling method '.version_select at 0x7fb5d64314c0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:34.702962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ddd7a5fa-fb1c-4f91-b1ca-88be2025f8d8 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088" status: 200 len: 352 microversion: 2.1 time: 0.110837 Aug 24 06:40:34.703690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 2/11] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:40:34 2022] GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:40:35.717556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-097ef33d-818d-4eb1-86d5-8c70dfe1c869 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Calling method '.version_select at 0x7fb5d63caaf0>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:35.849526 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-097ef33d-818d-4eb1-86d5-8c70dfe1c869 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088" status: 200 len: 353 microversion: 2.1 time: 0.131891 Aug 24 06:40:35.850492 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 10/12] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:40:35 2022] GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:40:35.867470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-bc677c78-cd06-45fc-aaca-2aff5cdbf71d tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Calling method '.version_select at 0x7fb5d6431820>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:36.030190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-bc677c78-cd06-45fc-aaca-2aff5cdbf71d tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088" status: 200 len: 353 microversion: 2.1 time: 0.170167 Aug 24 06:40:36.030760 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 3/13] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:40:35 2022] GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088 => generated 353 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:40:36.051618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f1ce1afe-09a8-4c19-8f40-0aba2bad9ed2 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Calling method '.version_select at 0x7fb5d63ca1f0>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:36.482199 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f1ce1afe-09a8-4c19-8f40-0aba2bad9ed2 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088" status: 202 len: 0 microversion: 2.1 time: 0.435593 Aug 24 06:40:36.482802 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 11/14] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:40:36 2022] DELETE /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:40:36.491867 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-00c2769e-3315-46be-9e34-04fcb3264018 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Calling method '.version_select at 0x7fb5d6431ca0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:36.612532 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-00c2769e-3315-46be-9e34-04fcb3264018 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088" status: 200 len: 352 microversion: 2.1 time: 0.124903 Aug 24 06:40:36.613696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 4/15] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:40:36 2022] GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:40:37.628156 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4250d34c-a7f9-4ca3-8cea-c56bf3c8a1d0 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Calling method '.version_select at 0x7fb5d63d21f0>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:37.680459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-4250d34c-a7f9-4ca3-8cea-c56bf3c8a1d0 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] HTTP exception thrown: Volume e5513a93-3974-4921-914f-959439985088 could not be found. Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4250d34c-a7f9-4ca3-8cea-c56bf3c8a1d0 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Request method failure captured: Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088 HTTP/1.1 Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfdGRp-bryzTN_okwmY8aXLBxRHHXb7vVeLENkgbtWYdc6x9GC_IcwutnM7iKVSdEd4H7oQy8Gz2IfxEn4kYe60-y1_07n46p9eyBuin5SE6Lf7KJI_srHe4v89KUsfO7hU_zYevionDEF3tSSJ4hboldfag_KsWAmB1GJoP9L7fYE Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 521a4e5109084dd2a7fb3fb73aa202af Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesGetTestJSON-1440966406 Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:40:37.683385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/521a4e5109084dd2a7fb3fb73aa202af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/521a4e5109084dd2a7fb3fb73aa202af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/521a4e5109084dd2a7fb3fb73aa202af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_521a4e5109084dd2a7fb3fb73aa202af", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesGetTestJSON-1440966406 Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 521a4e5109084dd2a7fb3fb73aa202af Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesGetTestJSON-1440966406 Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesGetTestJSON-1440966406-project Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 4125b9dd74a842bca7230e28171b226b Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesGetTestJSON-1440966406-project Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Volume e5513a93-3974-4921-914f-959439985088 could not be found. Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'e5513a93-3974-4921-914f-959439985088'} Aug 24 06:40:37.684738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e5513a93-3974-4921-914f-959439985088 could not be found. (HTTP 404) (Request-ID: req-aec58a07-0b90-4e9f-8c30-0b9a5f683991) Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:37.685703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:40:37.686931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e5513a93-3974-4921-914f-959439985088 could not be found. Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:40:37.688076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e5513a93-3974-4921-914f-959439985088 could not be found. Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e5513a93-3974-4921-914f-959439985088 could not be found. Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4250d34c-a7f9-4ca3-8cea-c56bf3c8a1d0 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] Returning 404 to user: Volume e5513a93-3974-4921-914f-959439985088 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4250d34c-a7f9-4ca3-8cea-c56bf3c8a1d0 tempest-VolumesGetTestJSON-1440966406 tempest-VolumesGetTestJSON-1440966406-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088" status: 404 len: 109 microversion: 2.1 time: 0.061729 Aug 24 06:40:37.689920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 12/16] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:40:37 2022] GET /compute/v2.1/os-volumes/e5513a93-3974-4921-914f-959439985088 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:40:44.489452 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-330f2c3b-e6d8-4b48-be7d-46edd9951628 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'create', calling method: .version_select at 0x7fb5d6441280>, body: {"keypair": {"name": "tempest-keypair-1416900111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB67w+otaUdFaFh85SDzw+ba5QkPCVxcqrlP4zySvu/xLAfmEwZtfpPXMtjsA6zT+BLllf3TIiKPI9lwK7tEkSBW1zHalcw/ggvnJTtPGFaroi4Yv9kQDlMVrVnGFbS/zA=="}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:44.645975 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-330f2c3b-e6d8-4b48-be7d-46edd9951628 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Getting quotas for project 096ae1367ad84c7aaa0b5e96e22e9e32. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:40:44.671120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-330f2c3b-e6d8-4b48-be7d-46edd9951628 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Getting quotas for user 8b9b29b53a7b490da29fbf6e5451c362 and project 096ae1367ad84c7aaa0b5e96e22e9e32. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:40:44.982862 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-330f2c3b-e6d8-4b48-be7d-46edd9951628 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.706835 Aug 24 06:40:44.984401 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 5/17] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:40:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:40:46.085969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1291310120", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "networks": [{"uuid": "64fa54ff-b9c9-4d2f-9081-9755bf9b530e"}]}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:46.361670 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] validate_networks() for [('64fa54ff-b9c9-4d2f-9081-9755bf9b530e', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:40:49.547492 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:40:49.548816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:40:49.549484 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:40:49.549892 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:40:49.550295 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:40:49.604508 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:49.608131 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:49.609248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:49.619423 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:49.619708 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:49.620157 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:49.681051 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Getting quotas for project ebc642b8ee3b4946aff553abbe94c26a. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:40:49.690533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Getting quotas for user 68b76ae7f1aa41f2acf7e18790887bd5 and project ebc642b8ee3b4946aff553abbe94c26a. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:40:49.705288 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:40:49.708523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:40:50.055099 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b23792c0-081b-450a-88a3-decb813f4f6a tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.330129 Aug 24 06:40:50.065761 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 13/18] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:40:50.070235 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5ede8e7e-4923-466d-8327-f24de2c66a26 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:50.071036 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5ede8e7e-4923-466d-8327-f24de2c66a26 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:50.318602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5ede8e7e-4923-466d-8327-f24de2c66a26 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:40:50.357015 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5ede8e7e-4923-466d-8327-f24de2c66a26 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1215 microversion: 2.1 time: 0.292042 Aug 24 06:40:50.374645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 6/19] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:50 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1215 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:40:51.266317 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-85d31f6a-c96b-44f1-877d-504a0a0e816e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: .version_select at 0x7fb5d5b88e50>, body: {"keypair": {"name": "tempest-keypair-1129889213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGt5cqNNm9BaXQNarKPQzKQuG19zo5JIi506WB2kbWzkgJMbHn65LVmXmfZQypqvjledBkXkB9C2W0ZzRClgfzeXr3vIxzTgxKniVujNjl9TqWYHlkw2PYBqh0cIKh/cdg=="}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:51.276769 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-972d1dad-1da1-4dd0-b5e3-6933bd3df69a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'create', calling method: .version_select at 0x7fb5d62d2550>, body: {"keypair": {"name": "tempest-keypair-556350054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzbJIsSXMXEwtmqVR7+VZNQHGugWnZtX8RyymSa02bJzZmzYlUozpRvvckQNJ/B4PUzkW5M+s9kEixDsI5g12RO2yC2LEDzbfV19YUUcFzTxVHcpEiC5c3GLzj6jPMA3w=="}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:51.365313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-85d31f6a-c96b-44f1-877d-504a0a0e816e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for project b91004b0497d487ea8f1f454c03bbca0. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:40:51.381987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-972d1dad-1da1-4dd0-b5e3-6933bd3df69a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Getting quotas for project e1bf995c8c544dc29f42e53866cc6bd2. Resources: {'key_pairs'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:40:51.406631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-85d31f6a-c96b-44f1-877d-504a0a0e816e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for user 02ad6cdc4ffe4917a7bbf6814297f980 and project b91004b0497d487ea8f1f454c03bbca0. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:40:51.414009 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-972d1dad-1da1-4dd0-b5e3-6933bd3df69a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Getting quotas for user 52f796d5013d4a31b107fb86c5523c9c and project e1bf995c8c544dc29f42e53866cc6bd2. Resources: {'key_pairs'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:40:51.650635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-85d31f6a-c96b-44f1-877d-504a0a0e816e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.873528 Aug 24 06:40:51.652198 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 7/20] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:40:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:40:51.663120 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-972d1dad-1da1-4dd0-b5e3-6933bd3df69a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.916430 Aug 24 06:40:51.672516 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 14/21] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Aug 24 06:40:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 927 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 06:40:51.689957 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d8aceab7-338b-4ab2-99f0-79cd52cf0256 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:51.694190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d8aceab7-338b-4ab2-99f0-79cd52cf0256 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:52.101231 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d8aceab7-338b-4ab2-99f0-79cd52cf0256 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:40:52.121598 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d8aceab7-338b-4ab2-99f0-79cd52cf0256 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1215 microversion: 2.1 time: 0.461037 Aug 24 06:40:52.122550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 8/22] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:51 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1215 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:40:53.151801 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-73012af9-07e4-4e0f-b902-a1ab95b87ea3 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:53.154675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-73012af9-07e4-4e0f-b902-a1ab95b87ea3 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:53.347904 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1976339877", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a22ad074-b1d8-4e4b-a73f-57c112fd6e15"}], "security_groups": [{"name": "tempest-securitygroup--688184060"}], "key_name": "tempest-keypair-1416900111", "user_data": "}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:53.526502 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-73012af9-07e4-4e0f-b902-a1ab95b87ea3 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:40:53.558474 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-73012af9-07e4-4e0f-b902-a1ab95b87ea3 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1215 microversion: 2.1 time: 0.412515 Aug 24 06:40:53.559534 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 15/23] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:53 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1215 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:40:53.666293 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] validate_networks() for [('a22ad074-b1d8-4e4b-a73f-57c112fd6e15', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:40:54.584925 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c6edade8-9697-410c-9241-ac56fb5fe277 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:54.586215 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c6edade8-9697-410c-9241-ac56fb5fe277 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:54.985977 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c6edade8-9697-410c-9241-ac56fb5fe277 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:40:54.994217 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c6edade8-9697-410c-9241-ac56fb5fe277 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1215 microversion: 2.1 time: 0.416460 Aug 24 06:40:54.999341 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 16/24] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:54 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1215 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:40:56.015296 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:56.016524 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:56.022889 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:56.023383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:56.023821 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:56.024534 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:56.024992 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:56.029627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:56.328191 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:40:56.328699 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:40:56.333964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:40:56.335857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:40:56.336484 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:40:56.368272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:56.369479 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:56.370870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:56.371897 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:56.372592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:56.373251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:56.402727 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:40:56.429021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Getting quotas for project 096ae1367ad84c7aaa0b5e96e22e9e32. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:40:56.438232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7360f784-bdf2-4816-9f18-b84d08fcdd1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1219 microversion: 2.1 time: 0.426790 Aug 24 06:40:56.451731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 17/25] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:56 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1219 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:40:56.482329 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Getting quotas for user 8b9b29b53a7b490da29fbf6e5451c362 and project 096ae1367ad84c7aaa0b5e96e22e9e32. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:40:56.578642 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:40:56.589103 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:40:56.871268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c1986df7-d704-4028-af29-5c003d92d68d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.530009 Aug 24 06:40:56.879805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 9/26] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:40:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 3532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:40:56.888753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e87fac2c-580f-4dd9-a2de-bfca1a337798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:56.889986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e87fac2c-580f-4dd9-a2de-bfca1a337798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:57.017123 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e87fac2c-580f-4dd9-a2de-bfca1a337798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:40:57.031459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e87fac2c-580f-4dd9-a2de-bfca1a337798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1238 microversion: 2.1 time: 0.149137 Aug 24 06:40:57.033626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 18/27] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:56 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1238 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:40:57.355590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2111686954", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14e1d9b8-7d9c-4824-8559-f6d63d615d5b"}], "security_groups": [{"name": "tempest-securitygroup--2122623615"}], "key_name": "tempest-keypair-1129889213", "user_data": "}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:57.480672 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:57.481601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:57.496508 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:57.497071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:57.497568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:57.498456 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:57.503522 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:57.504549 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:57.807433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:40:57.820792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fe27be6b-c293-499b-85e1-e2a1b4b7f8db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1275 microversion: 2.1 time: 0.346874 Aug 24 06:40:57.822010 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 19/28] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:57 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1275 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:40:57.904969 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] validate_networks() for [('14e1d9b8-7d9c-4824-8559-f6d63d615d5b', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:40:58.076781 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-40d4fd54-a4ea-47c3-9d3b-6232d80ef6de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:58.078319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-40d4fd54-a4ea-47c3-9d3b-6232d80ef6de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:58.282842 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-40d4fd54-a4ea-47c3-9d3b-6232d80ef6de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:40:58.304294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-40d4fd54-a4ea-47c3-9d3b-6232d80ef6de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1238 microversion: 2.1 time: 0.232702 Aug 24 06:40:58.316072 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 20/29] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:58 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1238 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:40:58.707920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1456369859", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4dc9d78-1179-43c9-875f-aca3db3dbf6c"}], "security_groups": [{"name": "tempest-securitygroup--535710961"}], "key_name": "tempest-keypair-556350054", "user_data": "}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:40:58.734856 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:40:58.736359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:40:58.737442 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:40:58.738500 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:40:58.739506 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:40:58.768516 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:58.769826 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:58.771429 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:58.773847 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:58.775242 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:58.776011 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:58.816215 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for project b91004b0497d487ea8f1f454c03bbca0. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:40:58.826653 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for user 02ad6cdc4ffe4917a7bbf6814297f980 and project b91004b0497d487ea8f1f454c03bbca0. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:40:58.860685 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:40:58.866124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:40:59.018589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] validate_networks() for [('f4dc9d78-1179-43c9-875f-aca3db3dbf6c', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:40:59.193369 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-52043383-954f-4541-8a81-4ef1738d6919 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.843620 Aug 24 06:40:59.196875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 10/30] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:40:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:40:59.214830 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:59.215985 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:59.234180 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:59.235841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:59.237133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:59.240783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:59.242334 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:59.243512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:59.701497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:59.746028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:40:59.804767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-135b8097-5d97-486d-aa60-142e08267d1f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1273 microversion: 2.1 time: 0.593036 Aug 24 06:40:59.810719 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 11/31] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:59 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1273 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:40:59.837128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d43bd8ba-a011-4e54-8c23-bbaa400ac706 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:59.842758 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d43bd8ba-a011-4e54-8c23-bbaa400ac706 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:00.016053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d43bd8ba-a011-4e54-8c23-bbaa400ac706 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:00.030783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d43bd8ba-a011-4e54-8c23-bbaa400ac706 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1242 microversion: 2.1 time: 0.218215 Aug 24 06:41:00.036394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 12/32] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:40:59 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1242 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:00.062120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:00.066161 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:00.094401 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:00.095124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:00.095857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:00.096982 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:00.100409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:00.101224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:00.311367 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:00.322414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3e162367-66c7-4de2-bd48-21fa336f6718 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1242 microversion: 2.1 time: 0.282736 Aug 24 06:41:00.352914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 13/33] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:00 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1242 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:00.845099 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:00.846321 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:00.864383 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:00.865062 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:00.865644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:00.866664 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:00.877847 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:00.881300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:01.269612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:41:01.273499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:41:01.273499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:41:01.273499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:41:01.273499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:41:01.355909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:01.360344 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:01.360828 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:01.369813 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:01.372366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:01.372878 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:01.493506 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Getting quotas for project e1bf995c8c544dc29f42e53866cc6bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:41:01.537028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:01.537256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Getting quotas for user 52f796d5013d4a31b107fb86c5523c9c and project e1bf995c8c544dc29f42e53866cc6bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:41:01.544470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-63b57a7a-a964-40e2-af39-12d31a8c2018 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.706159 Aug 24 06:41:01.546529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 14/34] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:00 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:01.552546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d50f263f-87c9-4f9a-8ebf-701a47acf658 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:01.557349 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d50f263f-87c9-4f9a-8ebf-701a47acf658 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:01.601578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:41:01.615777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:41:01.686392 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d50f263f-87c9-4f9a-8ebf-701a47acf658 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:01.713619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d50f263f-87c9-4f9a-8ebf-701a47acf658 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1242 microversion: 2.1 time: 0.165332 Aug 24 06:41:01.716291 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 15/35] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:01 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1242 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:01.741388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:01.741388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:01.769365 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:01.775778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:01.775778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:01.775778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:01.775778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:01.776290 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:01.913520 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cbfc9e72-94d4-46fa-a35e-7cea46e7e504 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.210535 Aug 24 06:41:01.915325 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 21/36] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Aug 24 06:40:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 3213 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 06:41:01.960806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-56fdeabc-614c-4412-a796-8a011063eb23 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:01.968451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-56fdeabc-614c-4412-a796-8a011063eb23 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:02.042869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:02.065763 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f1cd53b5-f275-4054-a1c4-0727bf539a74 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1290 microversion: 2.1 time: 0.348727 Aug 24 06:41:02.080068 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 16/37] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:01 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1290 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:02.216618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-56fdeabc-614c-4412-a796-8a011063eb23 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:02.252051 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-56fdeabc-614c-4412-a796-8a011063eb23 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:02.252051 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-56fdeabc-614c-4412-a796-8a011063eb23 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:02.253017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-56fdeabc-614c-4412-a796-8a011063eb23 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1281 microversion: 2.20 time: 0.324930 Aug 24 06:41:02.261861 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 22/38] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:01 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1281 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:02.582584 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:02.588457 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:02.670468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:02.671480 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:02.677316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:02.681425 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:02.684510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:02.685807 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:02.749263 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:02.750117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:02.763475 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:02.764031 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:02.766473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:02.771307 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:02.774121 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:02.776593 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:02.957861 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:02.985791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-932826a5-4b0b-48b1-9dcb-1c5c193933aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1238 microversion: 2.1 time: 0.241860 Aug 24 06:41:03.001581 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 23/39] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:02 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1238 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:03.095285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:03.096287 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:03.125966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:03.126992 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:03.127966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:03.129001 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:03.139605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:03.144018 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:03.484195 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:03.537219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9fc58d24-be51-4ee0-b786-fd15683bc6ad tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.942836 Aug 24 06:41:03.537219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 17/40] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:02 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:03.549887 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-40899e97-123a-431b-80f2-9226270cf1a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:03.550507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-40899e97-123a-431b-80f2-9226270cf1a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:03.663547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:03.698417 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4edfc164-6a1b-4224-85d5-640f96b97e3f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1308 microversion: 2.1 time: 0.607605 Aug 24 06:41:03.704160 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 24/41] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:03 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1308 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:03.766867 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-40899e97-123a-431b-80f2-9226270cf1a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:03.783643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-40899e97-123a-431b-80f2-9226270cf1a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:03.801609 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-40899e97-123a-431b-80f2-9226270cf1a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:03.808884 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-40899e97-123a-431b-80f2-9226270cf1a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1281 microversion: 2.20 time: 0.282265 Aug 24 06:41:03.810826 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 18/42] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:03 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1281 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:04.020809 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:04.021798 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:04.035119 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:04.038277 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:04.039494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:04.040924 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:04.043823 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:04.044395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:04.322903 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:04.366321 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-73a0f219-ebad-470c-96e4-848bdceb8e26 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1294 microversion: 2.1 time: 0.342882 Aug 24 06:41:04.371213 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 25/43] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:04 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1294 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:04.548645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:04.553127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:04.575002 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:04.579540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:04.580541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:04.584828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:04.586822 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:04.590894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:04.737023 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:04.738929 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:04.777440 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:04.779091 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:04.783855 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:04.786531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:04.787393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:04.798167 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:05.357388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:05.414260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-81a12333-e7b9-46c6-8cc3-8d9f5afdc385 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1296 microversion: 2.1 time: 0.684709 Aug 24 06:41:05.424802 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 26/44] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:04 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1296 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:05.452772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:05.455058 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:05.464274 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:05.471049 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:05.471939 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:05.473665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:05.489397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:05.490407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:05.638590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:05.693352 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-be70e2fb-7244-45a8-8468-df88916c3a71 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 1.143507 Aug 24 06:41:05.693352 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 19/45] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:04 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:05.718746 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:05.724384 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:05.738907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:05.740345 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:05.740815 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:05.746415 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:05.748442 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:05.750103 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:06.027049 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:06.095790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0548dcde-5e60-4c1a-ab22-a58da3bf77b5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.399182 Aug 24 06:41:06.099700 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 20/46] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:05 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:06.145096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:06.168520 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:06.171747 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:06.175138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7b110825-1ce6-4095-acca-9887e2ea5163 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1277 microversion: 2.20 time: 0.734169 Aug 24 06:41:06.181679 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 27/47] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:05 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1277 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:06.460494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:06.461203 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:06.477751 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:06.485554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:06.485554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:06.485554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:06.485554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:06.487225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:06.731730 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:06.732358 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:06.753140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:06.753678 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:06.754123 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:06.754839 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:06.763641 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:06.764493 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:07.168813 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:07.184011 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-014dea33-5783-4b62-9123-40cefa6152b8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.728121 Aug 24 06:41:07.195693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 21/48] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:06 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:07.195693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:07.195693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:07.199906 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:07.200677 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:07.201334 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:07.202575 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:07.203301 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:07.204147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:07.256167 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:07.269322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5a196862-4207-4d25-9b52-df0fb60f8df0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.542045 Aug 24 06:41:07.273336 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 28/49] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:06 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:07.294558 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:07.314135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-dcf2c45e-b2fa-4744-9516-cbeead1d44c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.127845 Aug 24 06:41:07.314976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 22/50] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:07 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:07.321264 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:07.323041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:07.333698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:07.337780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:07.338271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:07.338704 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:07.339409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:07.339859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:07.340284 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:07.429869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:07.443638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:07.446381 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:07.447639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3eb44735-a7dc-4166-b6eb-38d8fb46e515 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1341 microversion: 2.20 time: 0.131572 Aug 24 06:41:07.448429 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 23/51] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:07 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1341 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:07.658531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-a756054b-f01c-44d1-8219-a20fbc6427c4 req-6e7018f2-85d8-418d-8141-abfd2f7c1aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e152988-6f53-4e44-80d6-48c162de0042", "tag": "af945520-e966-4cd2-8c61-506c01a83099"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:07.679146 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-a756054b-f01c-44d1-8219-a20fbc6427c4 req-6e7018f2-85d8-418d-8141-abfd2f7c1aba service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:07.680203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-a756054b-f01c-44d1-8219-a20fbc6427c4 req-6e7018f2-85d8-418d-8141-abfd2f7c1aba service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:07.681360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-a756054b-f01c-44d1-8219-a20fbc6427c4 req-6e7018f2-85d8-418d-8141-abfd2f7c1aba service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:07.728666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-a756054b-f01c-44d1-8219-a20fbc6427c4 req-6e7018f2-85d8-418d-8141-abfd2f7c1aba service nova] Creating event network-changed:af945520-e966-4cd2-8c61-506c01a83099 for instance 6e152988-6f53-4e44-80d6-48c162de0042 on hv-cinder-85427 Aug 24 06:41:07.729829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-a756054b-f01c-44d1-8219-a20fbc6427c4 req-6e7018f2-85d8-418d-8141-abfd2f7c1aba service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127728) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 06:41:07.737363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-a756054b-f01c-44d1-8219-a20fbc6427c4 req-6e7018f2-85d8-418d-8141-abfd2f7c1aba service nova] Acquired lock "compute-rpcapi-router" {{(pid=127728) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 06:41:07.737363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e33c6e76-d7ef-4427-ac8a-5c07263de318 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:07.737363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e33c6e76-d7ef-4427-ac8a-5c07263de318 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:07.737363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e33c6e76-d7ef-4427-ac8a-5c07263de318 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:07.737363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e33c6e76-d7ef-4427-ac8a-5c07263de318 None None] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:07.738772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e33c6e76-d7ef-4427-ac8a-5c07263de318 None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:07.738772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e33c6e76-d7ef-4427-ac8a-5c07263de318 None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:07.754341 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.compute.rpcapi [None req-e33c6e76-d7ef-4427-ac8a-5c07263de318 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 06:41:07.755820 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e33c6e76-d7ef-4427-ac8a-5c07263de318 None None] Releasing lock "compute-rpcapi-router" {{(pid=127728) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 06:41:07.791362 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e33c6e76-d7ef-4427-ac8a-5c07263de318 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.517931 Aug 24 06:41:07.793690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 29/52] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:08.224611 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:08.228812 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:08.253811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:08.258555 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:08.258555 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:08.258555 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:08.259108 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:08.259914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:08.299307 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:08.300598 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:08.317280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:08.319901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:08.323924 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:08.326246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:08.328034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:08.331944 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:08.600863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:08.616628 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c7defd32-015f-4748-8e05-9c499ff6ba06 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.399882 Aug 24 06:41:08.619192 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 24/53] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:08 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:08.630265 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:08.638000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:08.650621 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:08.651590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:08.652616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:08.654197 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:08.655324 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:08.658933 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:08.688682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:08.698171 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8a24991c-aa47-4524-9979-e72c296f0f82 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.405077 Aug 24 06:41:08.702554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 30/54] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:08 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:08.710716 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:08.713025 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:08.735228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:08.735228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:08.735228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:08.736895 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:08.737425 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:08.737961 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:08.781648 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:08.793267 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=4 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:08.807884 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8932d1b8-0edd-463a-84ed-b36f863684ba tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.186893 Aug 24 06:41:08.821067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 25/55] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:08 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:08.839208 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:08.848522 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:08.850153 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:08.852448 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9ddec76f-5dbf-447f-bbcf-de8246816393 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1341 microversion: 2.20 time: 0.145502 Aug 24 06:41:08.853094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 31/56] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:08 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1341 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:09.647031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:09.647737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:09.657216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:09.657848 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:09.658383 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:09.659294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:09.659897 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:09.660538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:09.725814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:09.728945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:09.734654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:09.735432 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:09.735857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:09.736562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:09.737019 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:09.737479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:09.839970 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:09.863286 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-32d3a5cc-ca53-4bf4-bd52-42b46906bc4f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.219708 Aug 24 06:41:09.864455 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 26/57] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:09 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:09.882033 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:09.883916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:09.903006 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:09.904123 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:09.905999 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:09.907658 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:09.908306 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:09.909030 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:10.060323 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:10.078901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-135532c8-5e70-4d9f-937c-436067ffbe62 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.211877 Aug 24 06:41:10.080093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 27/58] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:09 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:10.095314 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:10.108351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:10.119994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:10.130727 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-36a8dcde-9ace-41c8-bf5f-ae0b6c49c1c2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.401785 Aug 24 06:41:10.132074 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 32/59] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:09 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:10.150332 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:10.151500 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:10.152407 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:10.156715 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:10.158231 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:10.159072 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:10.439118 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:10.451273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:10.452931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:10.456091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-544cfae0-d3e0-44c6-a197-9e9a4a5eaae4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1341 microversion: 2.20 time: 0.370522 Aug 24 06:41:10.457276 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 28/60] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:10 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1341 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:10.897752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:10.899245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:10.911856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:10.912983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:10.913742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:10.914618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:10.915093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:10.915578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:11.112581 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:11.115865 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:11.116487 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:11.123618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:11.124099 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:11.124826 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:11.125994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:11.126617 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:11.127047 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:11.134469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-94a85008-480c-4c17-917a-30697f88c9bc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.248269 Aug 24 06:41:11.136178 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 33/61] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:10 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:11.168181 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:11.169335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:11.178723 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:11.179849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:11.180761 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:11.181819 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:11.182413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:11.183145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:11.251644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:11.260526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:11.265867 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e9d3e1a8-6049-4551-aad4-a260aea3d5d5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.159146 Aug 24 06:41:11.266729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 29/62] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:11 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:11.417609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:11.417609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-705a99c0-bf4c-43ab-ae9f-a2858f7a724e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.247397 Aug 24 06:41:11.417609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 34/63] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:11 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:11.487468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:11.488495 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:11.501294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:11.504542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:11.506131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:11.507834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:11.508768 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:11.509982 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:11.598974 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:11.611604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:11.615119 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:11.615119 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c1d8df38-4495-42b8-9ed4-7654f492d0b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1341 microversion: 2.20 time: 0.135906 Aug 24 06:41:11.615380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 30/64] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:11 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1341 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:12.168396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:12.169841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:12.197668 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:12.198865 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:12.202512 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:12.203714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:12.205142 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:12.206798 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:12.251572 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=26 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:12.288790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:12.288790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:12.294166 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:12.294656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:12.295599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:12.297114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:12.297772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:12.298199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:12.382045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:12.393339 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1b24d04d-3d39-40a9-a2a9-c5c0e6149f81 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.109899 Aug 24 06:41:12.394362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 31/65] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:12 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:12.412357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:12.425217 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-28b4ccaf-eb33-4924-b411-ff2e74a265f9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.255114 Aug 24 06:41:12.438791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 35/66] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:12 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:12.463711 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:12.465046 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:12.479923 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:12.480748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:12.481744 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:12.483271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:12.483785 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:12.484354 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:12.641419 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:12.655132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:12.663884 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:12.673556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:12.676408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:12.682395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:12.682395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:12.683386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:12.797438 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:12.808066 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-51fab59a-c145-4fa9-9eab-992d14c0f2bf tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.363852 Aug 24 06:41:12.808919 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 32/67] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:12 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:12.837287 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:12.863576 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:12.863576 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:12.863576 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5a9d7809-f70c-4f41-9eab-24237a10f091 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1341 microversion: 2.20 time: 0.217650 Aug 24 06:41:12.864671 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 36/68] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:12 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:41:13.428905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:13.429839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:13.437072 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:13.437934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:13.438565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:13.439557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:13.440217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:13.442624 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:13.464285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:13.465537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:13.487485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:13.495464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:13.496673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:13.497530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:13.510860 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:13.511986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:13.513088 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:13.538197 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=100 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:13.546369 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:13.564284 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e5f23885-5025-40b5-92eb-1c65f4df299a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.135549 Aug 24 06:41:13.565983 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 33/69] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:13 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:13.757762 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:13.772508 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7628e2e9-d451-452d-8b48-06b843028eff tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.315614 Aug 24 06:41:13.773270 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 37/70] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:13 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:13.856555 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:13.857164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:13.860567 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=30 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:13.866429 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:13.866429 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:13.866733 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:13.867350 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:13.867796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:13.868222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:13.902865 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:13.903805 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:13.913607 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:13.914424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:13.915017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:13.916140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:13.916900 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:13.917510 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:14.097285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:14.114708 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:14.118676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:14.120990 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-01c158c6-e7c2-40ae-b6ca-0b3759f40f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1341 microversion: 2.20 time: 0.227188 Aug 24 06:41:14.141652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 38/71] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:13 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1341 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:14.182379 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:14.192223 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-93e0db8c-391a-4529-a612-970e83bdb0ec tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.339363 Aug 24 06:41:14.193562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 34/72] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:13 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:14.589490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:14.590296 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:14.597045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:14.597560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:14.598065 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:14.599767 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:14.600332 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:14.600916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:14.681787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:14.692321 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5c4a3e95-3bdc-43c3-853b-8e5d786c2ddc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.106665 Aug 24 06:41:14.696056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 39/73] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:14 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:14.797756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:14.798788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:14.808587 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:14.811536 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:14.811536 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:14.812372 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:14.813060 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:14.813784 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:15.170225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:15.170225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7c17b80e-0339-4649-ab5c-c2c2f5990d53 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.354523 Aug 24 06:41:15.170225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 35/74] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:14 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:15.170745 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:15.170745 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:15.188975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:15.189504 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:15.189936 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:15.190635 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:15.191081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:15.191495 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:15.228254 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:15.233106 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:15.240562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:15.241448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:15.242068 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:15.242988 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:15.243630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:15.244210 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:15.340352 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:15.362068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:15.366370 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:15.368984 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-faf40836-035d-4606-9fe0-e22a8c78e078 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1341 microversion: 2.20 time: 0.213425 Aug 24 06:41:15.380101 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 40/75] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:15 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:15.610783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:15.624853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d4466049-5576-4d92-af90-5e3d940f021e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.400358 Aug 24 06:41:15.626048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 36/76] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:15 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:15.716272 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:15.717715 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:15.727665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:15.728548 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:15.729355 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:15.730457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:15.731169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:15.731820 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:15.830194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:15.850881 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9bd8ebea-2208-49ed-af99-4f7771c23855 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.138022 Aug 24 06:41:15.852444 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 41/77] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:15 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:16.171094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:16.172193 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:16.186685 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.187588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.188945 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:16.190328 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.191186 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.191989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:16.429652 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:16.433984 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:16.434970 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:16.449949 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a928062b-c97d-4368-96af-f9b85439e6fe tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.283734 Aug 24 06:41:16.469579 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 37/78] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:16 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:16.470204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.470204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.470204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:16.470204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.470755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.470755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:16.580731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:16.602241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:16.606842 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:16.614782 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-088c06f9-c6cb-43c3-9593-fba178cb10ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1341 microversion: 2.20 time: 0.183305 Aug 24 06:41:16.616158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 42/79] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:16 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:16.652206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:16.655443 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:16.668603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.670633 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.671687 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:16.672584 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.673141 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.673676 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:16.877739 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:16.879373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:16.917559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.921171 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.923960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:16.927718 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.927718 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.936402 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:17.251267 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:17.283865 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d69d0bd8-3663-4ecc-9968-8ed3389dc98d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.638793 Aug 24 06:41:17.286175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 38/80] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:16 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:17.499985 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:17.501129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:17.511290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:17.538828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:17.546591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:17.546591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:17.546591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:17.546591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:17.547644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:17.561647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fe14e577-aed9-417b-9998-41e5ed3a9491 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.680436 Aug 24 06:41:17.561647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 43/81] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:16 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:17.653323 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:17.653958 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:17.713916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:17.713916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:17.713916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:17.713916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:17.714700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:17.714700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:17.761942 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=4 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:17.893073 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:17.950072 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:17.956398 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:17.975722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fb7d6fda-dc13-46ff-8b10-41fac79ae91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1351 microversion: 2.20 time: 0.316599 Aug 24 06:41:17.975722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 44/82] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:17 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1351 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:41:18.261869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:18.295334 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4cd23205-aa68-45b8-8df1-9a8468968be2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.801649 Aug 24 06:41:18.306437 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 39/83] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:17 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:18.350740 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:18.352127 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:18.365302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:18.366947 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:18.368048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:18.369620 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:18.371221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:18.372011 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:18.597206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:18.598664 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:18.611173 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:18.612035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:18.612747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:18.614400 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:18.615492 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:18.616512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:18.628274 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:18.648830 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f1dd274e-959f-40bd-9883-5bd6e87b2e37 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.311795 Aug 24 06:41:18.661408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 45/84] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:18 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:18.777658 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:18.800811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-167d8dd5-5738-4012-9143-99ca26ef2691 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1300 microversion: 2.1 time: 0.212537 Aug 24 06:41:18.813962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 40/85] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:18 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1300 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:19.020772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:19.021987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:19.037537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:19.037537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:19.037537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:19.037537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:19.038069 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:19.038331 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:19.175308 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:19.188554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:19.191278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:19.193443 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0731fb54-efbe-4150-af00-afc23c2aa223 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1339 microversion: 2.20 time: 0.181443 Aug 24 06:41:19.194744 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 46/86] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:19 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:19.354922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:19.356233 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:19.364015 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:19.364515 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:19.364948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:19.366071 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:19.366891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:19.367663 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:19.574076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:19.584535 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-14559f59-5ec1-4da5-a76c-78f036b2d4ee tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.236107 Aug 24 06:41:19.597578 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 41/87] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:19 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:19.671383 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:19.673877 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:19.678787 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:19.679475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:19.680140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:19.681131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:19.681682 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:19.682290 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:19.687900 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-2cb23575-8d63-4fa0-b5e1-513cf637e77f req-f1d3d976-1c35-4a08-bb48-41095cfb628d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821b76aa-235d-42ca-aec6-6597a19525c0", "tag": "093eee48-f69e-45f9-8131-16d82edc3341"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:19.705922 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-2cb23575-8d63-4fa0-b5e1-513cf637e77f req-f1d3d976-1c35-4a08-bb48-41095cfb628d service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:19.714980 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-2cb23575-8d63-4fa0-b5e1-513cf637e77f req-f1d3d976-1c35-4a08-bb48-41095cfb628d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:19.714980 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-2cb23575-8d63-4fa0-b5e1-513cf637e77f req-f1d3d976-1c35-4a08-bb48-41095cfb628d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:19.727666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-2cb23575-8d63-4fa0-b5e1-513cf637e77f req-f1d3d976-1c35-4a08-bb48-41095cfb628d service nova] Creating event network-changed:093eee48-f69e-45f9-8131-16d82edc3341 for instance 821b76aa-235d-42ca-aec6-6597a19525c0 on hv-cinder-85427 Aug 24 06:41:19.734682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-2cb23575-8d63-4fa0-b5e1-513cf637e77f req-f1d3d976-1c35-4a08-bb48-41095cfb628d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239820 Aug 24 06:41:19.735691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 47/88] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:19.825412 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:19.826281 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:19.833337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:19.833893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:19.834356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:19.835251 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:19.835794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:19.836481 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:19.901325 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:19.920053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-201ede4b-88fb-474d-a84f-01949a9cb894 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.252723 Aug 24 06:41:19.921136 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 42/89] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:19 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:20.018028 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:20.026847 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d9ae0aab-7534-43b2-a259-ff85c3433132 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.206059 Aug 24 06:41:20.027932 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 48/90] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:19 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:20.240825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:20.241455 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:20.247856 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:20.248350 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:20.248954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:20.249870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:20.250413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:20.251279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:20.347666 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:20.365015 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:20.368078 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:20.370173 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1b7fc6e2-abaa-4d3b-b0a0-87e9f38dd3b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1339 microversion: 2.20 time: 0.133059 Aug 24 06:41:20.371198 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 43/91] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:20 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:41:20.627483 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:20.628320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:20.638487 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:20.645933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:20.645933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:20.645933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:20.645933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:20.646720 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:20.808079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:20.819186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-35af213a-cceb-4a18-8093-284613c130f8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.200941 Aug 24 06:41:20.819763 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 49/92] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:20 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:20.950155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:20.952296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:20.965307 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:20.965307 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:20.965307 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:20.967523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:20.968266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:20.968946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:21.057728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:21.058513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:21.091791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:21.100777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:21.100777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:21.100777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:21.100777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:21.101512 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:21.415315 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:21.430045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f47cb841-f25d-42ae-abdf-dcf8771def03 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.484297 Aug 24 06:41:21.431296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 44/93] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:20 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:21.437359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:21.438333 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:21.444935 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:21.445823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:21.447217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:21.448229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:21.448967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:21.449713 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:21.586162 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:21.599447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:21.602251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:21.603790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1ef40ebf-fe2a-4450-be9f-e1058ee8131f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1339 microversion: 2.20 time: 0.171100 Aug 24 06:41:21.604435 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 45/94] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:21 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:21.619400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:21.628861 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-43d4cd26-765d-4089-b6a7-6b59396ed685 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.584373 Aug 24 06:41:21.630122 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 50/95] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:21 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:21.849344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:21.850473 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:21.859805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:21.860287 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:21.860789 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:21.861630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:21.862115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:21.862597 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:21.883054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:22.026359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:22.035143 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c7a134e8-9fd0-4129-93e5-f8cdb71a9fd5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.193512 Aug 24 06:41:22.035823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 46/96] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:21 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:22.479399 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:22.480279 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:22.494110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:22.494110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:22.494110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:22.494110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:22.494521 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:22.495240 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:22.630754 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:22.631371 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:22.639441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:22.640004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:22.640457 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:22.641246 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:22.641710 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:22.642133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:22.713703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:22.724879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:22.727134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d39c7738-16b8-4f6c-83c1-d1453c9c21db tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.252316 Aug 24 06:41:22.729134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 51/97] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:22 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:22.745856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:22.746957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:22.753967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:22.755595 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:22.756780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-58dfa282-4ebe-47bb-b5dd-5444b3fc9ea3 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1339 microversion: 2.20 time: 0.131602 Aug 24 06:41:22.757392 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 47/98] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:22 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1339 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:41:22.757799 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:22.780389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:22.780389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:22.780389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:22.780389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:22.781004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:23.068053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:23.069651 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:23.083077 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:23.083712 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:23.085320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:23.085855 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:23.086773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:23.087215 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:23.422273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:23.425556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:23.437100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f57983a6-5a73-4fa1-bc67-f7002cace4e7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.381777 Aug 24 06:41:23.438554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5d1bca94-e904-4a25-aeac-c4c7338042a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.707299 Aug 24 06:41:23.440356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 52/99] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:22 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:23.452810 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 48/100] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:23 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:23.760001 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:23.760881 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:23.770567 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:23.773470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:23.773470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:23.773470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:23.774036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:23.774705 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:23.810920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:23.812924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:23.821367 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:23.822255 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:23.822907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:23.823915 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:23.824483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:23.825215 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:23.947620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:23.972608 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:23.978053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:23.980500 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-dbd65ef1-f75b-4d3b-9ffc-2518daeffa90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1339 microversion: 2.20 time: 0.174230 Aug 24 06:41:23.982208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 49/101] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:23 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1339 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:41:24.200969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:24.214582 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c4b33324-04ab-4aa1-96aa-7a437b7678e6 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.457905 Aug 24 06:41:24.215847 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 53/102] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:23 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:24.458860 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:24.459463 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:24.467507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:24.468799 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:24.469413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:24.470103 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:24.470807 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:24.471523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:24.477742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:24.484855 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:24.493005 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:24.493721 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:24.494229 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:24.494984 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:24.495704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:24.496494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:24.551596 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=100 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:24.811464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:24.820926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e35360ea-4635-4378-b9e1-dd3ada4ec915 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.347212 Aug 24 06:41:24.822219 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 54/103] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:24 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:24.940690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:24.946838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-31e9f52d-7a6d-4403-9c0b-b14430736924 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.491678 Aug 24 06:41:24.947430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 50/104] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:24 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:25.024833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:25.025606 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:25.037815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.037815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.038411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.039261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.039809 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.040767 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.103841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-fb920ae7-800b-4786-8f88-94fc17c342d4 req-149f965c-fe44-4fa1-b2e4-44e440feee96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0298df5-f99f-4390-8f6f-3320fdfaff52", "tag": "096dd53a-4e6c-4db9-8564-fd9f67a455e7"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:25.124082 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-fb920ae7-800b-4786-8f88-94fc17c342d4 req-149f965c-fe44-4fa1-b2e4-44e440feee96 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.124664 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-fb920ae7-800b-4786-8f88-94fc17c342d4 req-149f965c-fe44-4fa1-b2e4-44e440feee96 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.125167 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-fb920ae7-800b-4786-8f88-94fc17c342d4 req-149f965c-fe44-4fa1-b2e4-44e440feee96 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.147786 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-fb920ae7-800b-4786-8f88-94fc17c342d4 req-149f965c-fe44-4fa1-b2e4-44e440feee96 service nova] Creating event network-changed:096dd53a-4e6c-4db9-8564-fd9f67a455e7 for instance b0298df5-f99f-4390-8f6f-3320fdfaff52 on hv-cinder-85427 Aug 24 06:41:25.148426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-fb920ae7-800b-4786-8f88-94fc17c342d4 req-149f965c-fe44-4fa1-b2e4-44e440feee96 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 06:41:25.149039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-fb920ae7-800b-4786-8f88-94fc17c342d4 req-149f965c-fe44-4fa1-b2e4-44e440feee96 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 06:41:25.150243 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-859daf92-9b26-4683-a825-1c2d28c0f291 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.150775 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-859daf92-9b26-4683-a825-1c2d28c0f291 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.151451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-859daf92-9b26-4683-a825-1c2d28c0f291 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.152364 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-859daf92-9b26-4683-a825-1c2d28c0f291 None None] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.153009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-859daf92-9b26-4683-a825-1c2d28c0f291 None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.154551 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-859daf92-9b26-4683-a825-1c2d28c0f291 None None] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.165344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.compute.rpcapi [None req-859daf92-9b26-4683-a825-1c2d28c0f291 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 06:41:25.166642 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-859daf92-9b26-4683-a825-1c2d28c0f291 None None] Releasing lock "compute-rpcapi-router" {{(pid=127727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 06:41:25.203499 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-859daf92-9b26-4683-a825-1c2d28c0f291 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104043 Aug 24 06:41:25.205056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 51/105] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:41:25.240928 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:25.241677 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:25.250666 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.251223 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.251663 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.252386 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.252915 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.253376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.265617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:25.275811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:25.277836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:25.282026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c7b981cc-de4d-4cc6-b7b1-22d713370c74 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.261135 Aug 24 06:41:25.283057 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 55/106] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:25 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:25.460708 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:25.468847 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8d22faa6-a03b-4a48-8985-1484e2370aac tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.232399 Aug 24 06:41:25.469423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 52/107] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:25 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:25.851518 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:25.852164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:25.858849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.859323 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.859776 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.860453 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.860901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.861366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.971406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:25.972282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:25.978580 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.978985 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.979414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:25.980100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:25.980542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:25.980997 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:26.002048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:26.011660 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b8779577-3d08-49e4-aa5e-7f181cff398e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.163134 Aug 24 06:41:26.011660 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 56/108] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:25 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:26.152902 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:26.162365 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-38a39e24-cc6c-4373-8d55-d378289d6549 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.198219 Aug 24 06:41:26.163117 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 53/109] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:25 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:26.314850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:26.315361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:26.321410 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:26.321890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:26.322337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:26.323023 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:26.323472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:26.323892 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:26.475095 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:26.485487 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:26.487050 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:26.488256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c4b768d1-cd60-42ca-a554-c8c2142e501b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.177433 Aug 24 06:41:26.488817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 57/110] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:26 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:41:26.492288 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:26.492894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:26.503512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:26.503512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:26.503512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:26.503512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:26.503909 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:26.503909 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:26.651803 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:26.660848 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ffbe3015-9ec9-4749-b1b3-8b278ec6d886 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.172731 Aug 24 06:41:26.661514 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 54/111] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:26 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:27.035056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:27.037078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:27.042985 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:27.043549 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:27.044631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:27.045499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:27.045954 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:27.046505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:27.185380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:27.186199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:27.193084 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:27.194117 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:27.194360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:27.195129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:27.195623 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:27.196083 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:27.212861 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:27.217435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3eeb244b-0fbc-42e1-b9ae-9bfe8e01596f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.189563 Aug 24 06:41:27.218305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 58/112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:27 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:27.350098 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:27.361996 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-55c3d5eb-ca44-4a2d-bb4e-b0ce8d3248a4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.180825 Aug 24 06:41:27.373426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 55/113] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:27 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:27.515137 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:27.515747 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:27.522289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:27.537415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:27.537415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:27.537415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:27.537415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:27.537913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:27.689800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:27.690403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:27.696241 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:27.696722 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:27.697147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:27.697864 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:27.698305 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:27.698719 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:27.722547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:27.724713 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:27.726578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:27.727787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c938f692-f720-42f0-a34d-0739c65e3a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.217212 Aug 24 06:41:27.728364 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 59/114] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:27 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:27.875588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:27.890239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0714bd75-3f22-464c-babd-c1c97e56095c tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.203938 Aug 24 06:41:27.890818 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 56/115] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:27 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:28.242618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:28.243641 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:28.251684 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.252305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.252797 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.253590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.254101 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.254703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.385272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:28.386861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:28.392961 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.393491 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.393914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.394592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.395295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.395725 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.429935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:28.437557 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7a13b19b-3fd4-411d-9bcf-6ef740eaf90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.199119 Aug 24 06:41:28.438135 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 60/116] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:28 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:28.583721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:28.613490 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-bde95dc1-46e7-4668-a69b-6b899fcb415b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.231755 Aug 24 06:41:28.616446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 57/117] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:28 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:28.753331 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:28.769174 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:28.769174 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.769174 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.769174 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.769760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.769760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.769760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.919289 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:28.920412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:28.928670 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.930063 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.930712 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.931627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.932229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.932836 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.962067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:28.980829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:28.983937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:28.985348 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6e3f8a50-0496-4801-b707-308469576718 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.238535 Aug 24 06:41:28.985930 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 61/118] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:28 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:29.117374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:29.126794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-26952e15-e61b-4343-9a59-36f7f5f4aa8b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.216225 Aug 24 06:41:29.127369 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 58/119] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:28 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:29.480732 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:29.481912 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:29.488309 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:29.488728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:29.489155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:29.489882 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:29.490323 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:29.494002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:29.648226 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:29.648986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:29.656316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:29.657002 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:29.657629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:29.658484 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:29.659086 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:29.659511 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:29.686704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:29.699611 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1263771e-e008-4088-aa35-73d87168025f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.222683 Aug 24 06:41:29.700447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 62/120] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:29 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:29.801034 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:29.812317 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-46e7bb4d-4b0e-4b9e-a6ba-940f671fecf2 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.175015 Aug 24 06:41:29.812856 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 59/121] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:29 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:30.013115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:30.013707 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:30.021257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:30.022154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:30.022604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:30.023363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:30.023899 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:30.024514 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:30.150245 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:30.150850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:30.157978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:30.165115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:30.165115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:30.165115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:30.165115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:30.165840 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:30.212781 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:30.229824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:30.231381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:30.232628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ca0532b7-e72c-4337-8a73-309148039b04 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.224701 Aug 24 06:41:30.233473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 63/122] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:30 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:30.349043 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:30.360242 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e9865f58-7884-4e81-bef5-bc11434e0787 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.213317 Aug 24 06:41:30.361506 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 60/123] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:30 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:30.723562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:30.725915 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:30.735145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:30.737838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:30.738486 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:30.739373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:30.742971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:30.744238 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:30.833761 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:30.834880 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:30.846123 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:30.846904 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:30.847514 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:30.848556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:30.849440 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:30.850075 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:31.118849 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:31.132863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e2f1fb02-7359-41b1-af56-c4d29dbe2603 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.301972 Aug 24 06:41:31.133503 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 61/124] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:30 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:31.256761 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:31.257839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:31.266359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:31.274630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:31.274630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:31.274630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:31.274630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:31.274978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:31.430070 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:31.440601 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:31.442256 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:31.443666 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a93110ce-4eb3-49aa-9e43-c34068b4a13b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.191077 Aug 24 06:41:31.444863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 62/125] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:31 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:31.458294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:31.460190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:31.468748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:31.469402 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:31.469954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:31.471576 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:31.472267 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:31.472895 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:31.501518 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:31.525092 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:31.535251 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7c6f7620-1f24-404c-8225-a1b9383d0ea5 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.815984 Aug 24 06:41:31.551111 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 64/126] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:30 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:31.646737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:31.655331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-995c1e7a-ca80-4590-a3a0-6a44b007fd4f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.209001 Aug 24 06:41:31.655866 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 63/127] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:31 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:32.159564 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:32.160782 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:32.169079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:32.169728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:32.170368 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:32.171555 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:32.172164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:32.172588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:32.212880 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-16271851-5997-426d-8fd7-8094f3344bf5 req-b740f2e3-5670-47cc-9752-c6475936ddf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5949cc-2133-40b8-9112-b5d571c05f9d", "tag": "e60cb872-95c0-4edd-942a-e19544fba59a"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:32.263138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-16271851-5997-426d-8fd7-8094f3344bf5 req-b740f2e3-5670-47cc-9752-c6475936ddf2 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:32.263774 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-16271851-5997-426d-8fd7-8094f3344bf5 req-b740f2e3-5670-47cc-9752-c6475936ddf2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:32.264149 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-16271851-5997-426d-8fd7-8094f3344bf5 req-b740f2e3-5670-47cc-9752-c6475936ddf2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:32.285531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-16271851-5997-426d-8fd7-8094f3344bf5 req-b740f2e3-5670-47cc-9752-c6475936ddf2 service nova] Creating event network-changed:e60cb872-95c0-4edd-942a-e19544fba59a for instance fa5949cc-2133-40b8-9112-b5d571c05f9d on hv-cinder-85427 Aug 24 06:41:32.290485 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-16271851-5997-426d-8fd7-8094f3344bf5 req-b740f2e3-5670-47cc-9752-c6475936ddf2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084174 Aug 24 06:41:32.291430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 64/128] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:32.423748 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:32.432251 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0e117904-401f-4e58-805e-f4ee063158a5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.277596 Aug 24 06:41:32.432865 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 65/129] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:32 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:32.469020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:32.469829 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:32.476411 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:32.476892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:32.477378 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:32.478113 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:32.478547 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:32.478965 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:32.558435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:32.559701 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:32.573728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:32.576005 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:32.576005 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:32.576005 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:32.576420 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:32.576845 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:32.658876 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:32.681404 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:32.683102 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:32.687918 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a158f08b-8b50-48a1-8df4-9047d879e819 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.221218 Aug 24 06:41:32.688708 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 65/130] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:32 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:32.706701 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:32.708396 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:32.719453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:32.720483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:32.720483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:32.722468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:32.722468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:32.722468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:32.817141 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:32.826604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1d8d4b6d-bd1a-4057-a6ba-ff284a425d48 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.272705 Aug 24 06:41:32.827684 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 66/131] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:32 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:32.956263 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:32.966394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d9c0807c-62b3-45d2-b216-29c5e1cbaef1 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.273190 Aug 24 06:41:32.967096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 66/132] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:32 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:33.274489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-ac641aa8-2caf-438a-afa9-031e0f6ec347 req-c27eb9ef-507d-4726-aeaa-8501320e4ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e152988-6f53-4e44-80d6-48c162de0042", "name": "network-vif-plugged", "status": "completed", "tag": "af945520-e966-4cd2-8c61-506c01a83099"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:33.289033 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-ac641aa8-2caf-438a-afa9-031e0f6ec347 req-c27eb9ef-507d-4726-aeaa-8501320e4ac5 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:33.289572 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-ac641aa8-2caf-438a-afa9-031e0f6ec347 req-c27eb9ef-507d-4726-aeaa-8501320e4ac5 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:33.289998 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-ac641aa8-2caf-438a-afa9-031e0f6ec347 req-c27eb9ef-507d-4726-aeaa-8501320e4ac5 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:33.302017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-ac641aa8-2caf-438a-afa9-031e0f6ec347 req-c27eb9ef-507d-4726-aeaa-8501320e4ac5 service nova] Creating event network-vif-plugged:af945520-e966-4cd2-8c61-506c01a83099 for instance 6e152988-6f53-4e44-80d6-48c162de0042 on hv-cinder-85427 Aug 24 06:41:33.307617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-ac641aa8-2caf-438a-afa9-031e0f6ec347 req-c27eb9ef-507d-4726-aeaa-8501320e4ac5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132693 Aug 24 06:41:33.308559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 67/133] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:33.456138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:33.456728 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:33.464737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:33.466436 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:33.467611 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:33.468706 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:33.469403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:33.470086 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:33.656085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:33.672206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-66ad0204-1d77-4ff5-a70f-43ae1a7ed7ec tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.221201 Aug 24 06:41:33.690872 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 67/134] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:33 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:33.711494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:33.712489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:33.720492 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:33.721407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:33.721834 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:33.722563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:33.722990 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:33.723408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:33.851659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:33.853792 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:33.867189 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:33.867903 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:33.868550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:33.870135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:33.870376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:33.871305 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:34.075973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:34.101666 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a0e34221-b03b-4757-ab37-8f63437c93cb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.254277 Aug 24 06:41:34.119748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 68/135] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:33 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:34.153592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:34.158805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:34.173022 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:34.179111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:34.179111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:34.179111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:34.179111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:34.180167 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:34.409054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:34.422712 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-97ecd541-b8fb-42e0-bfb7-7e738a0858c8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.288610 Aug 24 06:41:34.423823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 69/136] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:34 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:34.489588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:34.529422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:34.531325 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:34.532457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-decda735-9f45-40d6-93db-081a0107f80d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.825354 Aug 24 06:41:34.533373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 68/137] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:33 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:41:34.696752 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:34.697303 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:34.704176 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:34.709843 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:34.710290 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:34.711106 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:34.711531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:34.711948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:34.846550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:34.857692 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b8e11f17-d095-44dd-9c7d-dbaffbaba2fd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.164721 Aug 24 06:41:34.858276 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 70/138] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:34 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:35.124285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:35.124885 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:35.130843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.131609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.132118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.132938 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.133472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.134127 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.283406 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:35.291800 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f34ac6a5-8af5-4bed-9c7e-877bdf0070b9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.171828 Aug 24 06:41:35.292365 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 69/139] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:35 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:35.441962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:35.450156 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:35.451075 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:35.460523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.461684 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.462342 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.464006 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.465060 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.466915 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.557601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:35.559709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:35.568419 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.569474 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.570507 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.576588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.576588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.576588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.664031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:35.684184 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ab386b56-c296-4688-8840-7baf6d7a964e tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.242407 Aug 24 06:41:35.684807 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 71/140] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:35 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:35.878695 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:35.879285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:35.882029 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:35.886580 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.888304 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.889056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.889277 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:35.889986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.890601 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.890795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:35.891388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.892032 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-03ca816c-fbc4-48f3-b9dd-66de4217a176 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.339683 Aug 24 06:41:35.892590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 70/141] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:35 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:36.042382 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:36.051612 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4e2cbb41-74ea-4def-b2b2-c6942f9c2e0b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.176692 Aug 24 06:41:36.052203 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 72/142] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:35 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:36.313588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:36.314242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:36.320467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:36.320852 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:36.321315 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:36.322085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:36.322585 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:36.322910 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:36.469673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:36.474274 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=100 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:36.481645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-617ee85b-c4af-48b0-a401-6bc405c388b6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.172054 Aug 24 06:41:36.482694 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 71/143] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:36 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:36.604288 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-4b7bea43-23bf-4161-919c-b5a35dc6141a req-752503b4-02c6-41bf-b4d2-c1ccd32c1c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821b76aa-235d-42ca-aec6-6597a19525c0", "name": "network-vif-plugged", "status": "completed", "tag": "093eee48-f69e-45f9-8131-16d82edc3341"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:36.612362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:36.616561 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-4b7bea43-23bf-4161-919c-b5a35dc6141a req-752503b4-02c6-41bf-b4d2-c1ccd32c1c38 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:36.617301 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-4b7bea43-23bf-4161-919c-b5a35dc6141a req-752503b4-02c6-41bf-b4d2-c1ccd32c1c38 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:36.617934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-4b7bea43-23bf-4161-919c-b5a35dc6141a req-752503b4-02c6-41bf-b4d2-c1ccd32c1c38 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:36.632197 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-4b7bea43-23bf-4161-919c-b5a35dc6141a req-752503b4-02c6-41bf-b4d2-c1ccd32c1c38 service nova] Creating event network-vif-plugged:093eee48-f69e-45f9-8131-16d82edc3341 for instance 821b76aa-235d-42ca-aec6-6597a19525c0 on hv-cinder-85427 Aug 24 06:41:36.640122 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-4b7bea43-23bf-4161-919c-b5a35dc6141a req-752503b4-02c6-41bf-b4d2-c1ccd32c1c38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040045 Aug 24 06:41:36.640729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 73/144] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:41:36.707260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:36.707896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:36.714138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:36.714612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:36.715560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:36.716249 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:36.716706 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:36.717154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:36.934876 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:36.935964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:36.942800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:36.943605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:36.944106 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:36.944897 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:36.945470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:36.945955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:36.955549 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:36.965889 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-31a7cbb2-28b9-489d-a45b-d97b15a3512f tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.259942 Aug 24 06:41:36.966468 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 72/145] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:36 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:37.084654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:37.085292 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:37.089277 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:37.093967 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:37.093967 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:37.093967 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:37.093967 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:37.094387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:37.094812 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:37.100428 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:37.102169 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:37.103320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-52ade7f1-bf58-478c-b5cd-8598d68a0959 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.188890 Aug 24 06:41:37.103892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 74/146] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:36 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:37.251351 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:37.258755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a25d38fc-9752-479a-a6c6-275d03256441 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.177969 Aug 24 06:41:37.259321 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 73/147] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:37 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:37.503851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:37.504796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:37.512687 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:37.513469 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:37.514118 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:37.515034 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:37.515798 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:37.516635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:37.662410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:37.670607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-554664fc-ea86-4170-ab71-63d7b147241d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.170873 Aug 24 06:41:37.671331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 75/148] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:37 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:37.990714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:37.991987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:38.002724 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:38.003272 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:38.012160 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:38.012160 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:38.012160 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:38.012160 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:38.130427 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:38.131051 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:38.148696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:38.149405 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:38.151955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:38.153419 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:38.157994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:38.159358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:38.190853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:38.201365 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c5f714e2-4b3f-415f-91be-3ac19f791ec2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1315 microversion: 2.1 time: 0.216209 Aug 24 06:41:38.210996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 74/149] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:37 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:38.280996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:38.282122 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:38.317532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:38.320202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:38.321194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:38.325036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:38.326207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:38.327562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:38.405826 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:38.418326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:38.420431 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:38.421989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f7ecfcef-0451-42bf-a71a-94147e1f7358 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.298953 Aug 24 06:41:38.422588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 76/150] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:38 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:38.548890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:38.559957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-00567c78-d94d-42ba-a917-bcb8c58a8aad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.283339 Aug 24 06:41:38.560540 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 75/151] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:38 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:38.692805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:38.693504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:38.701030 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:38.701544 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:38.703959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:38.703959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:38.703959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:38.703959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:38.878899 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:38.888711 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-fa3ecd01-f0d5-4e2f-85d4-e89cf10fc30f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.199739 Aug 24 06:41:38.901789 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 77/152] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:38 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:39.226219 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:39.227238 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:39.246554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:39.248189 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:39.248685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:39.249615 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:39.250218 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:39.250814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:39.422104 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:39.430747 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bbad2ed8-51b7-4042-b631-beb4b3912afa tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1503 microversion: 2.1 time: 0.210296 Aug 24 06:41:39.445125 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:39.446343 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:39.447733 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 76/153] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:39 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:39.472318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:39.500728 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:39.500728 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:39.500728 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:39.500728 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:39.501392 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:39.583040 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:39.583997 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:39.592677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:39.595546 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:39.596063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:39.596883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:39.600608 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:39.601136 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:39.694054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:39.705197 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:39.707070 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:39.708216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-84fd730a-68d3-4819-9fa7-8f98531a218d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.268303 Aug 24 06:41:39.715321 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 78/154] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:39 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:39.880109 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:39.896901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b3790ad2-7e73-40b7-87ca-907ef5728212 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.318013 Aug 24 06:41:39.919300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:39.923149 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:39.930681 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:39.931039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:39.931470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:39.932172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:39.933577 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:39.934246 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:39.935801 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 77/155] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:39 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:40.084359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:40.092730 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7105238e-55b3-43b4-8174-d41a66465527 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.177994 Aug 24 06:41:40.093429 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 79/156] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:39 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:40.717553 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-c1bd48a0-6d45-44d1-ba2a-5f2fda021cf9 req-23edeb38-0cda-4e06-9afa-9c8cccc0fe20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0298df5-f99f-4390-8f6f-3320fdfaff52", "name": "network-vif-plugged", "status": "completed", "tag": "096dd53a-4e6c-4db9-8564-fd9f67a455e7"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:40.727926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-c1bd48a0-6d45-44d1-ba2a-5f2fda021cf9 req-23edeb38-0cda-4e06-9afa-9c8cccc0fe20 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:40.728414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-c1bd48a0-6d45-44d1-ba2a-5f2fda021cf9 req-23edeb38-0cda-4e06-9afa-9c8cccc0fe20 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:40.728839 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-c1bd48a0-6d45-44d1-ba2a-5f2fda021cf9 req-23edeb38-0cda-4e06-9afa-9c8cccc0fe20 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:40.731531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:40.732793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:40.739881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:40.740367 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:40.740822 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:40.744160 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-c1bd48a0-6d45-44d1-ba2a-5f2fda021cf9 req-23edeb38-0cda-4e06-9afa-9c8cccc0fe20 service nova] Creating event network-vif-plugged:096dd53a-4e6c-4db9-8564-fd9f67a455e7 for instance b0298df5-f99f-4390-8f6f-3320fdfaff52 on hv-cinder-85427 Aug 24 06:41:40.750218 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-c1bd48a0-6d45-44d1-ba2a-5f2fda021cf9 req-23edeb38-0cda-4e06-9afa-9c8cccc0fe20 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040393 Aug 24 06:41:40.751199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:40.751554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 78/157] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:40.752309 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:40.752638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:40.928434 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:40.929132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:40.959185 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:40.961197 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:40.962453 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:40.963406 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:40.964031 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:40.965164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:41.005031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:41.013562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:41.015086 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:41.016205 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3c0d4df2-eda6-49dc-882e-cbcb19aa266a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.289212 Aug 24 06:41:41.017271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 80/158] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:40 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:41:41.116981 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:41.118135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:41.125884 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:41.126460 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:41.127028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:41.128292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:41.129159 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:41.129839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:41.142204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:41.152596 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2bb4495c-b585-45f4-b1a8-137519989686 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.227913 Aug 24 06:41:41.153951 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:41.154754 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 79/159] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:40 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:41.289526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:41.299279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f465489f-8ff5-45ea-b6a5-e52c3ff686aa tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.187488 Aug 24 06:41:41.300125 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 81/160] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:41 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:42.042792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:42.043935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:42.051303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:42.051703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:42.052270 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:42.055337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:42.055816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:42.057132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:42.175756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:42.176367 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:42.194478 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:42.196157 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:42.196976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:42.198816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:42.199508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:42.200742 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:42.388335 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:42.421367 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ddcf5a0f-e40f-4081-a0dd-2b1e5711113c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1363 microversion: 2.1 time: 0.245809 Aug 24 06:41:42.422551 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 82/161] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:42 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:42.429134 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:42.430179 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:42.442314 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:42.443668 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:42.444391 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:42.445846 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:42.446027 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:42.446705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:42.447329 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:42.452928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:42.460554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:42.461780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9c06f019-6794-4334-8d24-c02c69b55056 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.423017 Aug 24 06:41:42.472541 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 80/162] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:42 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:42.602033 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:42.611344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-62809346-f8b9-4579-a9a0-bda989ef6f85 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1368 microversion: 2.1 time: 0.187315 Aug 24 06:41:42.613983 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 83/163] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:42 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:42.870549 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-adf0bceb-f02f-46cf-af2c-e9f160cafa58 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9846aa5-659e-4350-af59-fedff0390128"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:42.874929 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-adf0bceb-f02f-46cf-af2c-e9f160cafa58 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:42.882499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-adf0bceb-f02f-46cf-af2c-e9f160cafa58 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:42.883209 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-adf0bceb-f02f-46cf-af2c-e9f160cafa58 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:42.883904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-adf0bceb-f02f-46cf-af2c-e9f160cafa58 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:42.884771 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-adf0bceb-f02f-46cf-af2c-e9f160cafa58 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:42.885394 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-adf0bceb-f02f-46cf-af2c-e9f160cafa58 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:42.886018 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-adf0bceb-f02f-46cf-af2c-e9f160cafa58 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:43.443349 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:43.444519 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:43.452937 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:43.453689 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:43.455515 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:43.456283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:43.456940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:43.457395 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:43.614653 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:43.620792 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e45d82d8-1fd5-4d44-8ad4-5987ebc43c76 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1550 microversion: 2.1 time: 0.182060 Aug 24 06:41:43.621484 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 84/164] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:43 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1550 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:41:43.627138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:43.627783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:43.634515 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:43.635488 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:43.651019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:43.651019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:43.651019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:43.651019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:43.815006 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:43.827034 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:43.828561 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:43.829781 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5762e051-e779-4c86-afc3-f71fbcc65b7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.207276 Aug 24 06:41:43.830389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 85/165] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:43 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:43.835975 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:43.836589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:43.845483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:43.846133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:43.846425 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:43.847296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:43.848013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:43.848331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:44.050969 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:44.063847 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-dae6af73-df6c-4582-a4d6-23f330297067 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1558 microversion: 2.1 time: 0.232372 Aug 24 06:41:44.064804 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 86/166] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:43 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:44.071884 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-dc6189b8-a817-48e9-bf6e-c53094f2940e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:44.072794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-dc6189b8-a817-48e9-bf6e-c53094f2940e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:44.085738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dc6189b8-a817-48e9-bf6e-c53094f2940e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:44.086854 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dc6189b8-a817-48e9-bf6e-c53094f2940e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:44.087905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dc6189b8-a817-48e9-bf6e-c53094f2940e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:44.089255 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dc6189b8-a817-48e9-bf6e-c53094f2940e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:44.090348 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dc6189b8-a817-48e9-bf6e-c53094f2940e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:44.090936 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dc6189b8-a817-48e9-bf6e-c53094f2940e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:44.339240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-dc6189b8-a817-48e9-bf6e-c53094f2940e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.272633 Aug 24 06:41:44.341003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 87/167] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 24 06:41:44 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:44.347132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-166415cc-9e16-486e-8332-d6eb6a8c3656 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:44.347857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-166415cc-9e16-486e-8332-d6eb6a8c3656 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:44.357422 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166415cc-9e16-486e-8332-d6eb6a8c3656 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:44.357962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166415cc-9e16-486e-8332-d6eb6a8c3656 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:44.358400 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166415cc-9e16-486e-8332-d6eb6a8c3656 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:44.359251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166415cc-9e16-486e-8332-d6eb6a8c3656 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:44.359738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166415cc-9e16-486e-8332-d6eb6a8c3656 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:44.360249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166415cc-9e16-486e-8332-d6eb6a8c3656 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:44.481139 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-166415cc-9e16-486e-8332-d6eb6a8c3656 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137914 Aug 24 06:41:44.482239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 88/168] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 24 06:41:44 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:44.864479 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:44.865409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:44.885495 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:44.885971 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:44.886418 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:44.898222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:44.898967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:44.918539 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:45.713588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:45.729420 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:45.732543 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:45.733374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2dc914fa-0a9f-488c-b396-0e91ea158683 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.873133 Aug 24 06:41:45.734933 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 89/169] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:44 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:45.757273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-cf14e9eb-282b-4963-9492-08d09063e417 req-cc0a55e4-4f17-4289-9182-8a266456bca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5949cc-2133-40b8-9112-b5d571c05f9d", "name": "network-vif-plugged", "status": "completed", "tag": "e60cb872-95c0-4edd-942a-e19544fba59a"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:45.764727 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-adf0bceb-f02f-46cf-af2c-e9f160cafa58 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "POST /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.898456 Aug 24 06:41:45.770691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 81/170] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:41:42 2022] POST /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042/os-volume_attachments => generated 194 bytes in 2906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:45.784028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-cf14e9eb-282b-4963-9492-08d09063e417 req-cc0a55e4-4f17-4289-9182-8a266456bca9 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:45.784584 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-cf14e9eb-282b-4963-9492-08d09063e417 req-cc0a55e4-4f17-4289-9182-8a266456bca9 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:45.785018 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-cf14e9eb-282b-4963-9492-08d09063e417 req-cc0a55e4-4f17-4289-9182-8a266456bca9 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:45.813432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-cf14e9eb-282b-4963-9492-08d09063e417 req-cc0a55e4-4f17-4289-9182-8a266456bca9 service nova] Creating event network-vif-plugged:e60cb872-95c0-4edd-942a-e19544fba59a for instance fa5949cc-2133-40b8-9112-b5d571c05f9d on hv-cinder-85427 Aug 24 06:41:45.834916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-cf14e9eb-282b-4963-9492-08d09063e417 req-cc0a55e4-4f17-4289-9182-8a266456bca9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081041 Aug 24 06:41:45.836111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 90/171] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:46.448313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-9597b11b-fe26-4952-810f-4fc67a144af9 req-834f1ec1-78b9-4fec-ae87-22da124b91ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821b76aa-235d-42ca-aec6-6597a19525c0", "tag": "093eee48-f69e-45f9-8131-16d82edc3341"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:46.468050 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-9597b11b-fe26-4952-810f-4fc67a144af9 req-834f1ec1-78b9-4fec-ae87-22da124b91ee service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:46.471892 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-9597b11b-fe26-4952-810f-4fc67a144af9 req-834f1ec1-78b9-4fec-ae87-22da124b91ee service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:46.473611 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-9597b11b-fe26-4952-810f-4fc67a144af9 req-834f1ec1-78b9-4fec-ae87-22da124b91ee service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:46.502185 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-9597b11b-fe26-4952-810f-4fc67a144af9 req-834f1ec1-78b9-4fec-ae87-22da124b91ee service nova] Creating event network-changed:093eee48-f69e-45f9-8131-16d82edc3341 for instance 821b76aa-235d-42ca-aec6-6597a19525c0 on hv-cinder-85427 Aug 24 06:41:46.509117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-9597b11b-fe26-4952-810f-4fc67a144af9 req-834f1ec1-78b9-4fec-ae87-22da124b91ee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065459 Aug 24 06:41:46.509766 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 82/172] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:46.713137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-583221dd-c152-4c5e-bd7a-c8c205cc72e8 req-a859ab64-59ff-4213-a65e-eed0f7e238d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0298df5-f99f-4390-8f6f-3320fdfaff52", "tag": "096dd53a-4e6c-4db9-8564-fd9f67a455e7"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:46.731158 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-583221dd-c152-4c5e-bd7a-c8c205cc72e8 req-a859ab64-59ff-4213-a65e-eed0f7e238d0 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:46.732683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-583221dd-c152-4c5e-bd7a-c8c205cc72e8 req-a859ab64-59ff-4213-a65e-eed0f7e238d0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:46.733620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-583221dd-c152-4c5e-bd7a-c8c205cc72e8 req-a859ab64-59ff-4213-a65e-eed0f7e238d0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:46.750183 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-583221dd-c152-4c5e-bd7a-c8c205cc72e8 req-a859ab64-59ff-4213-a65e-eed0f7e238d0 service nova] Creating event network-changed:096dd53a-4e6c-4db9-8564-fd9f67a455e7 for instance b0298df5-f99f-4390-8f6f-3320fdfaff52 on hv-cinder-85427 Aug 24 06:41:46.757548 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-583221dd-c152-4c5e-bd7a-c8c205cc72e8 req-a859ab64-59ff-4213-a65e-eed0f7e238d0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054002 Aug 24 06:41:46.758745 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 91/173] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:46.770540 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:46.773434 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:46.782825 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:46.787511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:46.787511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:46.787511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:46.787511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:46.788071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:47.404742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:47.422332 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:47.435874 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:47.435874 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3c9a56b5-64f0-4e24-8219-05f690c2ff90 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.668183 Aug 24 06:41:47.437490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 83/174] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:46 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:48.460612 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:48.461979 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:48.469286 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:48.470523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:48.470523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:48.470906 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:48.471374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:48.471782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:48.644720 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:48.653777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:48.655270 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:48.656361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a1186f13-83b2-4c85-a24f-3244878fa182 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1406 microversion: 2.20 time: 0.200252 Aug 24 06:41:48.656913 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 92/175] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:48 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:49.677953 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:49.678593 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:49.686228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:49.686724 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:49.687180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:49.687934 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:49.688318 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:49.688742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:49.829843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:49.838479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:49.840692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:49.842003 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c25d8f73-96e0-4737-b471-5af61935e22c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1599 microversion: 2.20 time: 0.168215 Aug 24 06:41:49.849650 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 84/176] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:41:49 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:49.867824 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-23c3a342-2013-485f-b0e4-85fb42090e5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:49.867824 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-23c3a342-2013-485f-b0e4-85fb42090e5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:49.873839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23c3a342-2013-485f-b0e4-85fb42090e5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:49.874321 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23c3a342-2013-485f-b0e4-85fb42090e5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:49.874811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23c3a342-2013-485f-b0e4-85fb42090e5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:49.875522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23c3a342-2013-485f-b0e4-85fb42090e5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:49.875918 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23c3a342-2013-485f-b0e4-85fb42090e5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:49.876334 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23c3a342-2013-485f-b0e4-85fb42090e5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:49.955301 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-23c3a342-2013-485f-b0e4-85fb42090e5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093132 Aug 24 06:41:49.956233 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 93/177] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Aug 24 06:41:49 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:41:51.010462 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-42fe7fc5-928b-4c87-9641-bd97bf06fb18 req-42f78a74-c45b-4fc5-a745-35c31b19d472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5949cc-2133-40b8-9112-b5d571c05f9d", "tag": "e60cb872-95c0-4edd-942a-e19544fba59a"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:51.020785 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-42fe7fc5-928b-4c87-9641-bd97bf06fb18 req-42f78a74-c45b-4fc5-a745-35c31b19d472 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:51.021271 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-42fe7fc5-928b-4c87-9641-bd97bf06fb18 req-42f78a74-c45b-4fc5-a745-35c31b19d472 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:51.021972 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-42fe7fc5-928b-4c87-9641-bd97bf06fb18 req-42f78a74-c45b-4fc5-a745-35c31b19d472 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:51.035368 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-42fe7fc5-928b-4c87-9641-bd97bf06fb18 req-42f78a74-c45b-4fc5-a745-35c31b19d472 service nova] Creating event network-changed:e60cb872-95c0-4edd-942a-e19544fba59a for instance fa5949cc-2133-40b8-9112-b5d571c05f9d on hv-cinder-85427 Aug 24 06:41:51.040408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-42fe7fc5-928b-4c87-9641-bd97bf06fb18 req-42f78a74-c45b-4fc5-a745-35c31b19d472 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033542 Aug 24 06:41:51.041228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 85/178] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:56.962420 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:56.965292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:56.969557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:56.970089 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:56.970517 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:56.971212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:56.971658 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:56.972113 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:56.998486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:41:57.432059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-fea64b97-1ad2-42ec-ae4d-010c058806d5 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 204 len: 0 microversion: 2.1 time: 0.473406 Aug 24 06:41:57.433467 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 94/179] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:41:56 2022] DELETE /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:41:57.451617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:57.452389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:57.454398 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=97 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:57.459244 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:57.459727 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:57.460160 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:57.460853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:57.461328 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:57.461756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:57.628146 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:57.637054 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-734fa201-b269-4183-9cda-fb9a217c1324 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1555 microversion: 2.1 time: 0.193336 Aug 24 06:41:57.637992 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 86/180] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:57 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:58.667358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:58.668172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:58.674795 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:58.675305 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:58.675959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:58.676289 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:58.676657 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:58.676980 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:58.856747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:41:58.873905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d150e220-d0ed-4714-96dd-031680606d04 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1555 microversion: 2.1 time: 0.210991 Aug 24 06:41:58.889175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 95/181] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:58 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:59.902736 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:59.904049 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:59.923122 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:59.928138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:59.929470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:59.931871 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:59.935799 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:59.939218 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:00.222323 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:00.240140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-37aa9827-743d-4fa0-a0a6-026001c289d8 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1555 microversion: 2.1 time: 0.347888 Aug 24 06:42:00.245438 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 87/182] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:59 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1555 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:00.771957 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-93803f99-6c69-4d68-aa7e-867a2fe3958b req-d6fef2da-6504-4d22-a7e2-611c3f2d2eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e152988-6f53-4e44-80d6-48c162de0042", "name": "network-vif-deleted", "tag": "af945520-e966-4cd2-8c61-506c01a83099"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:00.786456 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-93803f99-6c69-4d68-aa7e-867a2fe3958b req-d6fef2da-6504-4d22-a7e2-611c3f2d2eb5 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:00.787021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-93803f99-6c69-4d68-aa7e-867a2fe3958b req-d6fef2da-6504-4d22-a7e2-611c3f2d2eb5 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:00.787763 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-93803f99-6c69-4d68-aa7e-867a2fe3958b req-d6fef2da-6504-4d22-a7e2-611c3f2d2eb5 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:00.804090 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-93803f99-6c69-4d68-aa7e-867a2fe3958b req-d6fef2da-6504-4d22-a7e2-611c3f2d2eb5 service nova] Creating event network-vif-deleted:af945520-e966-4cd2-8c61-506c01a83099 for instance 6e152988-6f53-4e44-80d6-48c162de0042 on hv-cinder-85427 Aug 24 06:42:00.815121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-93803f99-6c69-4d68-aa7e-867a2fe3958b req-d6fef2da-6504-4d22-a7e2-611c3f2d2eb5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046921 Aug 24 06:42:00.816430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 96/183] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:42:01.263237 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:01.264724 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:01.272884 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:01.273700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:01.274551 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:01.276808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:01.290623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:01.290623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:01.357592 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:01.366362 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3faa68ae-be0b-4726-99f8-1f1a3168f984 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1346 microversion: 2.1 time: 0.107155 Aug 24 06:42:01.366935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 88/184] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:01 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:02.390638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:02.392109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:02.398905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:02.399612 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:02.400207 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:02.403199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:02.404001 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:02.404572 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:02.447253 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:02.448072 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:02.449460 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:02.450134 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lazy-loading 'fault' on Instance uuid 6e152988-6f53-4e44-80d6-48c162de0042 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:42:02.503731 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b76ae7f1aa41f2acf7e18790887bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc642b8ee3b4946aff553abbe94c26a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:02.512875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a65296a4-e074-4512-bc87-256a2a4fb12d tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 200 len: 1351 microversion: 2.1 time: 0.127832 Aug 24 06:42:02.513650 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 97/185] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:02 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 1351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:03.540487 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:03.541086 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:03.549047 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:03.549563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:03.549987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:03.550672 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:03.551121 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:03.551533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:03.555837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:03.566567 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] HTTP exception thrown: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Request method failure captured: Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 HTTP/1.1 Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfsuPvWB5YpJFBpCgfJB21eufm-EQ4GwfNDTMdF3YTw2codDHZA-biwJrs6ol0_cEeuFZ4i3a8fDacZ4QEwW95MVWjc9yhpWzYw8Gbtmkgjbnr7-Mmnre7dBCA8Das94-BKWqfJXyJ31zGIAQmQMvfEKPBproxUM7OV5OsHmB6gGoM Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: ebc642b8ee3b4946aff553abbe94c26a Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:42:03.571246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ebc642b8ee3b4946aff553abbe94c26a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: ebc642b8ee3b4946aff553abbe94c26a Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-DeleteServersTestJSON-540783463-project Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 68b76ae7f1aa41f2acf7e18790887bd5 Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-DeleteServersTestJSON-540783463-project Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.572752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '6e152988-6f53-4e44-80d6-48c162de0042'} Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:42:03.573652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.574973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.576113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Returning 404 to user: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:42:03.576113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e99400e1-d9fc-40cd-a676-009d1d5d48b2 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 404 len: 111 microversion: 2.1 time: 0.036837 Aug 24 06:42:03.577630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 89/186] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:03 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:42:03.822405 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:03.825122 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:03.832278 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:03.832773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:03.833224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:03.833941 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:03.836164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:03.836164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:03.849499 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] HTTP exception thrown: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Request method failure captured: Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042/os-volume_attachments HTTP/1.1 Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfsuPvWB5YpJFBpCgfJB21eufm-EQ4GwfNDTMdF3YTw2codDHZA-biwJrs6ol0_cEeuFZ4i3a8fDacZ4QEwW95MVWjc9yhpWzYw8Gbtmkgjbnr7-Mmnre7dBCA8Das94-BKWqfJXyJ31zGIAQmQMvfEKPBproxUM7OV5OsHmB6gGoM Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: ebc642b8ee3b4946aff553abbe94c26a Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:42:03.866602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ebc642b8ee3b4946aff553abbe94c26a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: ebc642b8ee3b4946aff553abbe94c26a Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-DeleteServersTestJSON-540783463-project Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 68b76ae7f1aa41f2acf7e18790887bd5 Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-DeleteServersTestJSON-540783463-project Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.868208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'server_id': '6e152988-6f53-4e44-80d6-48c162de0042'} Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:42:03.869007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:03.872318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:03.873851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Returning 404 to user: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:42:03.873851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e567fcfc-d66d-4c19-836f-1a612c2ed80b tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051242 Aug 24 06:42:03.875631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 98/187] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:42:03 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:42:05.387150 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:05.387924 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:05.395110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:05.395829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:05.396260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:05.396953 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:05.397595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:05.398173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:05.414516 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] HTTP exception thrown: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Request method failure captured: Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 HTTP/1.1 Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfsuPvWB5YpJFBpCgfJB21eufm-EQ4GwfNDTMdF3YTw2codDHZA-biwJrs6ol0_cEeuFZ4i3a8fDacZ4QEwW95MVWjc9yhpWzYw8Gbtmkgjbnr7-Mmnre7dBCA8Das94-BKWqfJXyJ31zGIAQmQMvfEKPBproxUM7OV5OsHmB6gGoM Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: ebc642b8ee3b4946aff553abbe94c26a Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:42:05.416488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ebc642b8ee3b4946aff553abbe94c26a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: ebc642b8ee3b4946aff553abbe94c26a Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-DeleteServersTestJSON-540783463-project Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 68b76ae7f1aa41f2acf7e18790887bd5 Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-DeleteServersTestJSON-540783463-project Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.418255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '6e152988-6f53-4e44-80d6-48c162de0042'} Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:42:05.418964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.420203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.425241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Returning 404 to user: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:42:05.425241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-034b0d5e-937b-40b9-96c1-41550f0e1742 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 404 len: 111 microversion: 2.1 time: 0.040793 Aug 24 06:42:05.425241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 90/188] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:42:05 2022] DELETE /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:42:05.433986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:05.434622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] [instance: 6e152988-6f53-4e44-80d6-48c162de0042] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:05.443671 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:05.444423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:05.444790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:05.445607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:05.446513 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:05.446942 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:05.463829 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] HTTP exception thrown: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Request method failure captured: Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 HTTP/1.1 Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfsuPvWB5YpJFBpCgfJB21eufm-EQ4GwfNDTMdF3YTw2codDHZA-biwJrs6ol0_cEeuFZ4i3a8fDacZ4QEwW95MVWjc9yhpWzYw8Gbtmkgjbnr7-Mmnre7dBCA8Das94-BKWqfJXyJ31zGIAQmQMvfEKPBproxUM7OV5OsHmB6gGoM Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: ebc642b8ee3b4946aff553abbe94c26a Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:42:05.466208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ebc642b8ee3b4946aff553abbe94c26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ebc642b8ee3b4946aff553abbe94c26a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: ebc642b8ee3b4946aff553abbe94c26a Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-DeleteServersTestJSON-540783463 Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-DeleteServersTestJSON-540783463-project Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 68b76ae7f1aa41f2acf7e18790887bd5 Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-DeleteServersTestJSON-540783463-project Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.467693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '6e152988-6f53-4e44-80d6-48c162de0042'} Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:42:05.468361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. Aug 24 06:42:05.476357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:05.477544 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] Returning 404 to user: Instance 6e152988-6f53-4e44-80d6-48c162de0042 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:42:05.477544 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-95fc1213-1c2e-49d2-a3c4-6266609084c0 tempest-DeleteServersTestJSON-540783463 tempest-DeleteServersTestJSON-540783463-project] 10.222.0.47 "GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042" status: 404 len: 111 microversion: 2.1 time: 0.042754 Aug 24 06:42:05.477544 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 99/189] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:05 2022] GET /compute/v2.1/servers/6e152988-6f53-4e44-80d6-48c162de0042 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:42:09.444411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-244170459", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "networks": [{"uuid": "5b664d95-88fc-4b48-8784-4dfb9cc6e541"}]}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:09.532736 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] validate_networks() for [('5b664d95-88fc-4b48-8784-4dfb9cc6e541', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:42:10.122108 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:42:10.123081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:42:10.123578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:42:10.124134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:42:10.124716 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:42:10.135427 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:10.135908 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:10.136397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:10.137501 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:10.140395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:10.140395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:10.160476 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Getting quotas for project 2affaa1f6bef4cdcb559126588333d96. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:42:10.165417 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Getting quotas for user bb4a45146170497098d2071618ea6469 and project 2affaa1f6bef4cdcb559126588333d96. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:42:10.204692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:42:10.227534 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:42:10.482875 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bbce0ea1-db92-4d0a-a3d4-2e1cab7b9e59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043458 Aug 24 06:42:10.485708 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 91/190] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:42:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:42:10.502121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-324b728f-6668-412d-ac86-a724d8159434 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:10.502762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-324b728f-6668-412d-ac86-a724d8159434 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:10.505857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:10.635616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-324b728f-6668-412d-ac86-a724d8159434 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:10.662379 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-324b728f-6668-412d-ac86-a724d8159434 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1213 microversion: 2.1 time: 0.166564 Aug 24 06:42:10.663901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 100/191] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:10 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:11.699359 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c0b6dd59-050b-4b71-a8b7-f36963032718 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:11.700722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c0b6dd59-050b-4b71-a8b7-f36963032718 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:11.794568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c0b6dd59-050b-4b71-a8b7-f36963032718 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:11.811518 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c0b6dd59-050b-4b71-a8b7-f36963032718 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1213 microversion: 2.1 time: 0.111809 Aug 24 06:42:11.822063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 92/192] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:11 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:12.836545 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:12.837149 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:12.844960 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:12.845664 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:12.846230 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:12.847097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:12.848118 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:12.848696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:12.877900 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:12.939853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:12.951250 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-68051e26-63af-4aca-9f75-fe62e22aba05 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1217 microversion: 2.1 time: 0.118834 Aug 24 06:42:12.952450 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 101/193] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:12 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:13.973828 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:13.974541 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:13.982223 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:13.983038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:13.983613 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:13.984712 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:13.985277 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:13.985769 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:14.061594 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:14.069413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-02fafb33-cec0-4571-a17e-8b814270a600 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1217 microversion: 2.1 time: 0.100940 Aug 24 06:42:14.069995 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 93/194] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:13 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:15.091225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:15.091818 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:15.099370 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:15.100071 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:15.100502 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:15.101208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:15.101661 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:15.102074 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:15.170307 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:15.177901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1686a0e6-e215-4165-9461-6d65c3d011f4 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1265 microversion: 2.1 time: 0.090773 Aug 24 06:42:15.178457 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 102/195] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:15 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:16.200933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:16.201887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:16.213467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:16.214659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:16.215313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:16.216292 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:16.216976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:16.217644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:16.309352 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:16.318051 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-de60e468-84e2-4792-8e46-7d2de1a313e9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1283 microversion: 2.1 time: 0.122344 Aug 24 06:42:16.318687 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 94/196] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:16 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1283 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:17.351793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:17.352476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:17.361097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:17.361614 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:17.362045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:17.362925 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:17.363625 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:17.364207 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:17.588150 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:17.595995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-455da58d-27f5-4f06-b07e-e11641634953 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.248773 Aug 24 06:42:17.604365 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 103/197] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:17 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:18.628381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:18.630011 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:18.642170 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:18.643294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:18.644349 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:18.646484 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:18.648746 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:18.653911 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:18.911859 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:18.927095 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f8aa3759-5f92-4655-81f6-9ab02f84bcd3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.306111 Aug 24 06:42:18.927687 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 95/198] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:18 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:19.325646 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-fcf2de8f-4bcf-48e3-b069-42c3e802407f req-d382c2e2-88f8-4847-a353-52595d2ef10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d589c3-d980-42f8-b555-9f8cd4c2de59", "tag": "9603a6cd-80d0-4d8e-a90b-3608d038256d"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:19.340251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-fcf2de8f-4bcf-48e3-b069-42c3e802407f req-d382c2e2-88f8-4847-a353-52595d2ef10d service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:19.341953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-fcf2de8f-4bcf-48e3-b069-42c3e802407f req-d382c2e2-88f8-4847-a353-52595d2ef10d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:19.342354 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-fcf2de8f-4bcf-48e3-b069-42c3e802407f req-d382c2e2-88f8-4847-a353-52595d2ef10d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:19.363728 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-fcf2de8f-4bcf-48e3-b069-42c3e802407f req-d382c2e2-88f8-4847-a353-52595d2ef10d service nova] Creating event network-changed:9603a6cd-80d0-4d8e-a90b-3608d038256d for instance 62d589c3-d980-42f8-b555-9f8cd4c2de59 on hv-cinder-85427 Aug 24 06:42:19.368819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-fcf2de8f-4bcf-48e3-b069-42c3e802407f req-d382c2e2-88f8-4847-a353-52595d2ef10d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047415 Aug 24 06:42:19.369446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 104/199] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:42:19.959930 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:19.960621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:19.973408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:19.973930 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:19.976008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:19.976008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:19.976476 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:19.976899 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:20.148911 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:20.259891 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:20.269838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1851348a-22b7-497d-a1a7-8e920a925c28 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.309953 Aug 24 06:42:20.281253 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 96/200] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:19 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:21.029634 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:21.185674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-360267684", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:21.255528 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] validate_networks() for [('0592023d-8a9c-41f3-89af-bb66dbebd3a5', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:42:21.296757 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:21.297653 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:21.316268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:21.321661 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:21.322508 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:21.323607 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:21.324437 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:21.325136 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:21.500437 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:21.511912 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5cf0ed9a-b603-4345-abcb-b48e70d1744a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.222540 Aug 24 06:42:21.512532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 97/201] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:21 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:21.728134 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:42:21.732271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:42:21.732765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:42:21.733170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:42:21.733638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:42:21.748040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:21.916003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:21.916003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:21.916003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:21.916003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:21.923065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:21.923065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Getting quotas for project 50896ec327454f28b1987cd4271b6e27. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:42:21.923065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Getting quotas for user 026744699ed54dce8dc240e44e8aefb3 and project 50896ec327454f28b1987cd4271b6e27. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:42:21.923065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:42:21.923592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:42:22.194871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-34aca594-d52c-4264-8f62-0b1a033d01cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.166079 Aug 24 06:42:22.197255 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 105/202] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:42:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:42:22.209089 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e8f1c7b1-c872-4e02-adc8-fee0ba436402 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:22.210737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e8f1c7b1-c872-4e02-adc8-fee0ba436402 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:22.213875 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=8 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:22.298335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e8f1c7b1-c872-4e02-adc8-fee0ba436402 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:22.325089 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e8f1c7b1-c872-4e02-adc8-fee0ba436402 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1221 microversion: 2.1 time: 0.120378 Aug 24 06:42:22.326709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 98/203] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:22 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:22.415967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1781943434", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:22.486283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] validate_networks() for [('0592023d-8a9c-41f3-89af-bb66dbebd3a5', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:42:22.534775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:22.535787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:22.546055 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:22.546853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:22.547531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:22.548766 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:22.549445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:22.550067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:22.722916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:22.734022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cc211913-5634-4eb9-98b7-9cc7404a09bb tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.203923 Aug 24 06:42:22.735217 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 99/204] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:22 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:22.980854 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:42:22.988394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:42:22.989276 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:42:22.989871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:42:22.990297 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:42:23.000931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:23.001594 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:23.002128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:23.003004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:23.003646 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:23.004171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:23.025792 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Getting quotas for project 50896ec327454f28b1987cd4271b6e27. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:42:23.031274 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Getting quotas for user 026744699ed54dce8dc240e44e8aefb3 and project 50896ec327454f28b1987cd4271b6e27. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:42:23.047950 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:42:23.047950 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:42:23.265057 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-afbd2c6f-0a36-4dae-9934-295985215369 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.855723 Aug 24 06:42:23.266689 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 106/205] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:42:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:42:23.278121 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-df2cc39b-8898-4ebd-9c75-3adec31d4c3e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:23.280619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-df2cc39b-8898-4ebd-9c75-3adec31d4c3e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:23.403693 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-df2cc39b-8898-4ebd-9c75-3adec31d4c3e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:23.410602 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-df2cc39b-8898-4ebd-9c75-3adec31d4c3e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1222 microversion: 2.1 time: 0.137923 Aug 24 06:42:23.411453 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 100/206] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:23 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:23.755994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:23.756603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:23.764044 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:23.764665 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:23.765040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:23.765874 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:23.766229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:23.766615 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:24.020169 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:24.030366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b76e35a6-e70c-4947-b952-a874823ec136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.278183 Aug 24 06:42:24.031062 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 107/207] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:23 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:24.434105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:24.437605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:24.443415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:24.444233 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:24.445052 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:24.445579 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:24.446112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:24.446587 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:24.520752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:24.533795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bccae184-75c9-496c-b19b-522f9f75fb9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1226 microversion: 2.1 time: 0.106091 Aug 24 06:42:24.534611 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 101/208] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:24 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:25.050938 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:25.051585 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:25.058807 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:25.059559 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:25.060297 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:25.061134 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:25.061764 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:25.066426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:25.204473 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:25.213106 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-00e78d29-2de5-4a62-9c55-9c4db0104cda tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.165768 Aug 24 06:42:25.213746 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 108/209] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:25 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:25.557682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:25.562721 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:25.566085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:25.566581 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:25.567013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:25.567754 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:25.568205 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:25.568631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:25.643666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:25.655273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-13e23948-0210-4533-9080-990b21c43abc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1226 microversion: 2.1 time: 0.103841 Aug 24 06:42:25.655894 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 102/210] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:25 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:26.234503 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:26.235216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:26.241116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:26.241726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:26.242226 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:26.243777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:26.244408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:26.245121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:26.387674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:26.395461 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ae43c88d-a9f9-40db-a195-432766f20108 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.164765 Aug 24 06:42:26.396183 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 109/211] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:26 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:26.675794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:26.676440 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:26.684182 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:26.685023 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:26.685322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:26.686081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:26.686731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:26.687161 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:26.751765 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:26.759431 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d08cc433-8e15-487b-bf88-afd5e38fdc46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1226 microversion: 2.1 time: 0.087461 Aug 24 06:42:26.760000 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 103/212] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:26 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:27.416187 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:27.416854 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:27.422822 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:27.423302 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:27.423732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:27.424420 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:27.424870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:27.425330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:27.567520 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:27.577854 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6e8b6ca2-17f9-4099-9aa5-fd0087a08c93 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.166411 Aug 24 06:42:27.578624 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 110/213] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:27 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:27.780674 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:27.781324 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:27.792186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:27.792809 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:27.793268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:27.793980 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:27.794492 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:27.794842 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:27.892677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:27.892677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3f107ec4-f274-436c-9edb-c8f9fc2448e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1226 microversion: 2.1 time: 0.111936 Aug 24 06:42:27.892677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 104/214] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:27 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:28.600729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:28.601503 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:28.608362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:28.608991 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:28.609263 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:28.610027 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:28.610476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:28.610912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:28.777037 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:28.788447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e126b10d-9161-42b5-9691-808da9228494 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.192656 Aug 24 06:42:28.789032 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 111/215] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:28 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:28.911600 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:28.912287 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:28.919663 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:28.920163 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:28.920601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:28.921345 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:28.921807 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:28.922236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:28.991505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:29.000071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3eaa2051-d967-4a8e-92d3-466d70160687 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1226 microversion: 2.1 time: 0.092326 Aug 24 06:42:29.000645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 105/216] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:28 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:29.809857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:29.810458 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:29.816870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:29.817366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:29.817794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:29.818487 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:29.818936 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:29.819336 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:30.022149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:30.022909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:30.034193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:30.036631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:30.037015 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:30.037823 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:30.038755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:30.040266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:30.041036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:30.070927 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:30.081664 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d4f599e2-a308-4f04-924d-ec24b684cade tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.275284 Aug 24 06:42:30.083513 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 112/217] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:29 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:30.121337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:30.130193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b7d2b4c4-90f3-4370-bc91-8e4820d86562 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1274 microversion: 2.1 time: 0.113221 Aug 24 06:42:30.130793 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 106/218] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:30 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1274 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:31.108690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:31.109546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:31.118882 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:31.119882 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:31.120318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:31.123629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:31.124094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:31.126321 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:31.156538 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:31.157746 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:31.167605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:31.168447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:31.168887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:31.169619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:31.170076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:31.170496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:31.279445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:31.289495 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-beceb5b6-a259-42bb-bd13-2841935262bc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1280 microversion: 2.1 time: 0.138792 Aug 24 06:42:31.308033 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 107/219] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:31 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:31.421091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:31.430112 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a94963f6-cdb9-4ccb-86a0-3bd92466f2e1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.325649 Aug 24 06:42:31.435239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 113/220] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:31 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:31.483930 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-6e2bd0ea-3349-40c3-8c03-e4cce8036795 req-235d4fbf-c8d6-4b56-8449-4e95dd10697d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d589c3-d980-42f8-b555-9f8cd4c2de59", "name": "network-vif-plugged", "status": "completed", "tag": "9603a6cd-80d0-4d8e-a90b-3608d038256d"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:31.502313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-6e2bd0ea-3349-40c3-8c03-e4cce8036795 req-235d4fbf-c8d6-4b56-8449-4e95dd10697d service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:31.502806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-6e2bd0ea-3349-40c3-8c03-e4cce8036795 req-235d4fbf-c8d6-4b56-8449-4e95dd10697d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:31.504702 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-6e2bd0ea-3349-40c3-8c03-e4cce8036795 req-235d4fbf-c8d6-4b56-8449-4e95dd10697d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:31.524811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-6e2bd0ea-3349-40c3-8c03-e4cce8036795 req-235d4fbf-c8d6-4b56-8449-4e95dd10697d service nova] Creating event network-vif-plugged:9603a6cd-80d0-4d8e-a90b-3608d038256d for instance 62d589c3-d980-42f8-b555-9f8cd4c2de59 on hv-cinder-85427 Aug 24 06:42:31.530943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-6e2bd0ea-3349-40c3-8c03-e4cce8036795 req-235d4fbf-c8d6-4b56-8449-4e95dd10697d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050347 Aug 24 06:42:31.536298 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 108/221] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:42:32.316702 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:32.317509 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:32.327423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:32.327943 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:32.328394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:32.332674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:32.333168 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:32.333636 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:32.436934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:32.450140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d808499f-5887-4d34-81fa-b0336e0a4f1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1280 microversion: 2.1 time: 0.137143 Aug 24 06:42:32.451295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 114/222] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:32 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:32.463812 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:32.464520 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:32.476161 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:32.477333 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:32.477807 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:32.478728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:32.479183 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:32.480015 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:32.825068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:32.834634 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-eaaf5d94-ebd9-4c09-90bd-018e75cb55f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.379635 Aug 24 06:42:32.835247 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 109/223] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:32 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:33.474939 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:33.476427 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:33.481095 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=4 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:33.482130 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=12 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:33.490316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:33.496818 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:33.496818 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:33.496818 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:33.496818 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:33.497483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:33.740257 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:33.748067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1688b944-d76a-4995-97b8-eb9d0c46d552 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.279101 Aug 24 06:42:33.748645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 115/224] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:33 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:33.869808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:33.870422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:33.873616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-14d60755-876f-4c21-b05a-0a9d53079fe6 req-9aa2d3cb-fa19-471d-82e3-f9188c686f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb56c577-522f-4ef5-a3e2-d65c466ebdda", "tag": "4f95b5cf-f500-4e87-abba-fb8400f87b79"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:33.895183 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:33.895599 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:33.896030 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:33.905978 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:33.906819 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:33.907254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:33.921965 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-14d60755-876f-4c21-b05a-0a9d53079fe6 req-9aa2d3cb-fa19-471d-82e3-f9188c686f4d service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:33.927898 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-14d60755-876f-4c21-b05a-0a9d53079fe6 req-9aa2d3cb-fa19-471d-82e3-f9188c686f4d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:33.928513 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-14d60755-876f-4c21-b05a-0a9d53079fe6 req-9aa2d3cb-fa19-471d-82e3-f9188c686f4d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:33.955576 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-14d60755-876f-4c21-b05a-0a9d53079fe6 req-9aa2d3cb-fa19-471d-82e3-f9188c686f4d service nova] Creating event network-changed:4f95b5cf-f500-4e87-abba-fb8400f87b79 for instance eb56c577-522f-4ef5-a3e2-d65c466ebdda on hv-cinder-85427 Aug 24 06:42:33.966365 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-14d60755-876f-4c21-b05a-0a9d53079fe6 req-9aa2d3cb-fa19-471d-82e3-f9188c686f4d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103731 Aug 24 06:42:33.967284 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 116/225] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:42:34.192702 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:34.202769 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-dcd60392-f7f3-46d5-a992-e6c3ce571682 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1313 microversion: 2.1 time: 0.346870 Aug 24 06:42:34.203772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 110/226] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:33 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:34.773050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:34.777247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:34.788362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:34.791001 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:34.792211 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:34.793376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:34.794005 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:34.795121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:35.047091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:35.060538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5f18a0bf-537b-4f03-9a91-a94866737cac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.295355 Aug 24 06:42:35.063013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 117/227] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:34 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:35.237814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:35.239781 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:35.242285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=4 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:35.251210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:35.252012 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:35.252665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:35.255407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:35.267048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:35.267851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:35.298609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=100 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:35.911965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:35.924083 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4cd89175-5182-4cc3-b938-d4b01a47fc5b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1497 microversion: 2.1 time: 0.691995 Aug 24 06:42:35.934963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 111/228] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:35 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1497 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:35.984228 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-afafe4fa-207d-4243-944e-73d70de9656f req-bbcda337-3f60-4fe7-a61a-7d97935c2315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adfd4e5-f3c8-444f-99f9-d084d14aae09", "tag": "c3fa2262-7172-4ec4-8561-3e3a0af603de"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:35.996111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-afafe4fa-207d-4243-944e-73d70de9656f req-bbcda337-3f60-4fe7-a61a-7d97935c2315 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:35.996644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-afafe4fa-207d-4243-944e-73d70de9656f req-bbcda337-3f60-4fe7-a61a-7d97935c2315 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:36.004355 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-afafe4fa-207d-4243-944e-73d70de9656f req-bbcda337-3f60-4fe7-a61a-7d97935c2315 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:36.010528 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-afafe4fa-207d-4243-944e-73d70de9656f req-bbcda337-3f60-4fe7-a61a-7d97935c2315 service nova] Creating event network-changed:c3fa2262-7172-4ec4-8561-3e3a0af603de for instance 4adfd4e5-f3c8-444f-99f9-d084d14aae09 on hv-cinder-85427 Aug 24 06:42:36.015606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-afafe4fa-207d-4243-944e-73d70de9656f req-bbcda337-3f60-4fe7-a61a-7d97935c2315 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035100 Aug 24 06:42:36.016426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 118/229] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:42:36.081916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:36.082519 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:36.094130 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:36.094869 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:36.095817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:36.102602 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:36.102602 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:36.102602 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:36.257963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:36.265784 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-63a7d3ef-c1a6-488d-9470-33d9dd6d75a9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.188128 Aug 24 06:42:36.266381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 112/230] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:36 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:37.287798 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:37.290821 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:37.297900 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:37.298697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:37.299226 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:37.300050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:37.300613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:37.301271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:37.336621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:37.337770 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:37.345745 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:37.346926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:37.347362 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:37.348061 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:37.348516 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:37.348935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:37.376359 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:42:37.456386 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:37.465216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-233403ce-dafc-4708-9078-c4e7674f7b96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.181905 Aug 24 06:42:37.465787 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 119/231] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:37 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:37.840115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b12169b9-7b9e-4de1-9edf-0b0576d8d82f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "DELETE /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 204 len: 0 microversion: 2.1 time: 0.508257 Aug 24 06:42:37.840966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 113/232] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:42:37 2022] DELETE /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:42:37.853546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:37.853546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:37.858260 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:37.858748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:37.859175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:37.859867 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:37.860388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:37.860804 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:38.008356 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:38.016574 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c2288b7d-5ea1-45c3-8cdd-02a238bf587f tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.171122 Aug 24 06:42:38.017148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 120/233] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:37 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:38.498182 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:38.498921 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:38.506512 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:38.507187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:38.507637 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:38.508557 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:38.509377 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:38.510108 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:38.669749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:38.679103 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ce8c6d3a-213b-41df-9567-7448791feb54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.190148 Aug 24 06:42:38.689966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 114/234] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:38 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:39.038284 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:39.040261 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:39.046733 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:39.051313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:39.051313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:39.051313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:39.051313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:39.051708 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:39.067789 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:39.235256 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:39.244515 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8e4c9066-3800-47e5-8d4b-fbd014011fed tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.210356 Aug 24 06:42:39.245105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 121/235] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:39 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:39.704269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:39.704986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:39.711855 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:39.715849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:39.715849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:39.715849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:39.715849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:39.716220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:39.904270 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:39.912995 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6c6be5a5-f268-4c20-97e9-bae34eef1f08 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.212468 Aug 24 06:42:39.914614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 115/236] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:39 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:40.284851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:40.286171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:40.295057 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:40.295551 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:40.295986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:40.297000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:40.298303 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:40.298303 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:40.514569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:40.525751 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-261f4b00-431f-4225-b361-380f1eb9a5ae tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.244916 Aug 24 06:42:40.531426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 122/237] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:40 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:40.936732 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:40.937294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:40.943998 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:40.944484 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:40.945595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:40.946961 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:40.947415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:40.947840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:41.130294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:41.148609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-83441d38-29b8-48a0-8fe3-0b37c7c53d8b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.215724 Aug 24 06:42:41.149366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 116/238] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:40 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:41.547764 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:41.548554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:41.555831 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:41.556313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:41.556739 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:41.557558 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:41.558005 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:41.558420 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:41.775697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:41.784482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-147f135c-b44d-44d8-97ad-3e31b3b8c222 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.240538 Aug 24 06:42:41.785081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 123/239] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:41 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:42.171114 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:42.171889 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:42.178651 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:42.179409 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:42.180567 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:42.181531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:42.182428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:42.183062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:42.353658 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:42.362013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fdf03b49-a144-4c00-893a-305b4fdde0b2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.194587 Aug 24 06:42:42.377916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 117/240] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:42 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:42.809167 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:42.809737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:42.816941 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:42.816941 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:42.817406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:42.818214 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:42.818932 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:42.819348 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:43.061505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:43.073655 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a149266d-c7a1-4e52-8a6d-47b6a0d6254a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.270722 Aug 24 06:42:43.087723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 124/241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:42 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:43.386013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:43.387414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:43.394238 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:43.394878 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:43.395667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:43.396456 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:43.396921 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:43.397654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:43.549943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:43.559766 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2a76c9d1-da34-4606-a04f-4c85f6bae5e3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.178836 Aug 24 06:42:43.563505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 118/242] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:43 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:44.096049 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:44.096886 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:44.117170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:44.121471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:44.122301 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:44.123443 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:44.124528 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:44.125477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:44.359898 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:44.374438 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c49c3c0f-ab97-4e34-89b6-8507050a6f20 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.279307 Aug 24 06:42:44.374438 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 125/243] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:44 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:44.582247 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:44.582946 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:44.591459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:44.591964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:44.592401 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:44.593098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:44.593611 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:44.594029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:44.773397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:44.781661 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1d14e976-90ec-4176-b0e0-ce1f4c35b47f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.203267 Aug 24 06:42:44.782409 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 119/244] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:44 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:45.393421 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:45.394190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:45.397616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:45.402078 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:45.402716 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:45.403265 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:45.404274 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:45.404977 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:45.405629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:45.566195 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:45.574672 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7ca415af-fe22-4474-b04d-11c7ddfd5317 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.185343 Aug 24 06:42:45.575263 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 126/245] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:45 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:45.807033 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:45.807657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:45.815386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:45.815879 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:45.816315 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:45.817033 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:45.817517 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:45.817936 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:46.003997 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:46.014880 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2ecf8607-3f3d-49e5-8f42-b349d7556f88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.211737 Aug 24 06:42:46.026272 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 120/246] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:45 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:46.599333 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:46.600091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:46.606594 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:46.607188 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:46.607698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:46.608732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:46.609410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:46.609927 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:46.813973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:46.823786 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5323eb2f-5d3c-4563-83bb-5c2f31de78f5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.230107 Aug 24 06:42:46.825001 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 127/247] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:46 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:47.040021 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:47.041333 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:47.046758 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-7fa49404-a640-4f5f-81d1-97f6e76eeb79 req-8397cce5-140a-4d16-b19d-404b64b4fcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb56c577-522f-4ef5-a3e2-d65c466ebdda", "name": "network-vif-plugged", "status": "completed", "tag": "4f95b5cf-f500-4e87-abba-fb8400f87b79"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:47.049975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:47.050852 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:47.051500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:47.052307 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:47.052890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:47.053511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:47.061778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-7fa49404-a640-4f5f-81d1-97f6e76eeb79 req-8397cce5-140a-4d16-b19d-404b64b4fcd5 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:47.062195 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-7fa49404-a640-4f5f-81d1-97f6e76eeb79 req-8397cce5-140a-4d16-b19d-404b64b4fcd5 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:47.082094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-7fa49404-a640-4f5f-81d1-97f6e76eeb79 req-8397cce5-140a-4d16-b19d-404b64b4fcd5 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:47.116781 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-7fa49404-a640-4f5f-81d1-97f6e76eeb79 req-8397cce5-140a-4d16-b19d-404b64b4fcd5 service nova] Creating event network-vif-plugged:4f95b5cf-f500-4e87-abba-fb8400f87b79 for instance eb56c577-522f-4ef5-a3e2-d65c466ebdda on hv-cinder-85427 Aug 24 06:42:47.123202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-7fa49404-a640-4f5f-81d1-97f6e76eeb79 req-8397cce5-140a-4d16-b19d-404b64b4fcd5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081146 Aug 24 06:42:47.124737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 128/248] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:42:47.425883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:47.453311 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b35aed3d-f728-401e-8e25-dcf14d3edfc9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.420063 Aug 24 06:42:47.457149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 121/249] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:47 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:47.850474 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:47.856951 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:47.864308 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:47.864870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:47.865404 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:47.866085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:47.867366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:47.867775 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:48.132994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:48.143348 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-076e254b-f00e-4d4a-9538-7ef2831c0018 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.299868 Aug 24 06:42:48.154762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 129/250] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:47 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:48.484125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:48.484736 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:48.492361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:48.492917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:48.493679 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:48.494220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:48.494675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:48.495096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:49.169018 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:49.170567 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:49.177150 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:49.177887 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:49.178486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:49.180461 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:49.180909 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:49.181376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:49.269614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:49.290136 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d0d4b049-c606-49dc-b8b1-af3d1b6276c9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.809758 Aug 24 06:42:49.293593 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 122/251] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:48 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:49.524364 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:49.534821 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6ed2a4f6-c10b-4337-b4bf-2ef2892cb0f1 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1503 microversion: 2.1 time: 0.369968 Aug 24 06:42:49.536720 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 130/252] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:49 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1503 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:49.590211 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-cb78ce81-47d2-454f-bb2a-8007187a5683 req-03876417-d3c6-424c-8785-d6e41d8c4370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d589c3-d980-42f8-b555-9f8cd4c2de59", "name": "network-vif-deleted", "tag": "9603a6cd-80d0-4d8e-a90b-3608d038256d"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:49.604810 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-cb78ce81-47d2-454f-bb2a-8007187a5683 req-03876417-d3c6-424c-8785-d6e41d8c4370 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:49.605599 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-cb78ce81-47d2-454f-bb2a-8007187a5683 req-03876417-d3c6-424c-8785-d6e41d8c4370 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:49.606195 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-cb78ce81-47d2-454f-bb2a-8007187a5683 req-03876417-d3c6-424c-8785-d6e41d8c4370 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:49.622265 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-cb78ce81-47d2-454f-bb2a-8007187a5683 req-03876417-d3c6-424c-8785-d6e41d8c4370 service nova] Creating event network-vif-deleted:9603a6cd-80d0-4d8e-a90b-3608d038256d for instance 62d589c3-d980-42f8-b555-9f8cd4c2de59 on hv-cinder-85427 Aug 24 06:42:49.628741 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-cb78ce81-47d2-454f-bb2a-8007187a5683 req-03876417-d3c6-424c-8785-d6e41d8c4370 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042358 Aug 24 06:42:49.629303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 123/253] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:42:50.311814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:50.313395 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:50.322218 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:50.326093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:50.326093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:50.326093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:50.326093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:50.326444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:50.552210 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:50.568176 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:50.569981 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:50.577271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8715f655-8125-4cea-80d0-2360f25b1fad tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.269382 Aug 24 06:42:50.581321 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:50.583015 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:50.583015 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:50.583015 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:50.583415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:50.583728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:50.588540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 131/254] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:50 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:50.683353 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:50.712269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f28f22e5-a5f6-4703-8ba7-e10fce505274 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1298 microversion: 2.1 time: 0.148016 Aug 24 06:42:50.721668 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 124/255] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:50 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1298 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:51.593017 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-dbb6255e-7612-437a-b591-e384d06db800 req-77bb1d95-ed5b-43c2-8571-17f55211e8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adfd4e5-f3c8-444f-99f9-d084d14aae09", "name": "network-vif-plugged", "status": "completed", "tag": "c3fa2262-7172-4ec4-8561-3e3a0af603de"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:51.614602 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:51.615210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:51.632407 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-dbb6255e-7612-437a-b591-e384d06db800 req-77bb1d95-ed5b-43c2-8571-17f55211e8d2 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:51.633023 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-dbb6255e-7612-437a-b591-e384d06db800 req-77bb1d95-ed5b-43c2-8571-17f55211e8d2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:51.634592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-dbb6255e-7612-437a-b591-e384d06db800 req-77bb1d95-ed5b-43c2-8571-17f55211e8d2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:51.647599 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:51.650362 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:51.650810 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:51.651578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:51.652030 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:51.652447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:51.665221 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-dbb6255e-7612-437a-b591-e384d06db800 req-77bb1d95-ed5b-43c2-8571-17f55211e8d2 service nova] Creating event network-vif-plugged:c3fa2262-7172-4ec4-8561-3e3a0af603de for instance 4adfd4e5-f3c8-444f-99f9-d084d14aae09 on hv-cinder-85427 Aug 24 06:42:51.672889 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-dbb6255e-7612-437a-b591-e384d06db800 req-77bb1d95-ed5b-43c2-8571-17f55211e8d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085409 Aug 24 06:42:51.675589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 132/256] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:42:51.740124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:51.744584 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:51.758273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:51.762690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:51.762690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:51.762690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:51.778406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:51.779664 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:51.848717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:51.849570 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:51.851189 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:51.851965 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lazy-loading 'fault' on Instance uuid 62d589c3-d980-42f8-b555-9f8cd4c2de59 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:42:51.918102 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:51.927950 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-70130280-a6d5-49be-aae6-07d521458d76 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 200 len: 1303 microversion: 2.1 time: 0.194628 Aug 24 06:42:51.930041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 133/257] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:51 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:51.986373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:52.003538 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3f23e7a4-a1f2-4a10-abff-03524de9327a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.392897 Aug 24 06:42:52.005020 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 125/258] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:51 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:52.956418 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:52.957812 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: 62d589c3-d980-42f8-b555-9f8cd4c2de59] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:52.987617 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:52.988124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:52.988562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:53.003211 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:53.004930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:53.011266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:53.025442 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:53.026163 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:53.040852 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:53.042542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] HTTP exception thrown: Instance 62d589c3-d980-42f8-b555-9f8cd4c2de59 could not be found. Aug 24 06:42:53.043104 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:53.043623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Request method failure captured: Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 HTTP/1.1 Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcg9mNQNfifNrJtQAqHCr9yxEnOS-tMgHwGJbF7zrDHkH4viQtVSSf3TYhR0_Ono0b8xzwwka_ebgjbKpYPb2iVygkWkH5dvcVDnB2vFwA7TpT9X9Nlk3kSSsFJxluKJnXMQVwFn8fnfzwfCrVg_9Oh52CLWhv-q6Ogbi_mbUIKcfJM Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 2affaa1f6bef4cdcb559126588333d96 Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-VolumesActionsTest-1465906438 Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:42:53.045266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2affaa1f6bef4cdcb559126588333d96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2affaa1f6bef4cdcb559126588333d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2affaa1f6bef4cdcb559126588333d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2affaa1f6bef4cdcb559126588333d96", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-VolumesActionsTest-1465906438 Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 2affaa1f6bef4cdcb559126588333d96 Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-VolumesActionsTest-1465906438 Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-VolumesActionsTest-1465906438-project Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: bb4a45146170497098d2071618ea6469 Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-VolumesActionsTest-1465906438-project Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 62d589c3-d980-42f8-b555-9f8cd4c2de59 could not be found. Aug 24 06:42:53.046526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '62d589c3-d980-42f8-b555-9f8cd4c2de59'} Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d589c3-d980-42f8-b555-9f8cd4c2de59 could not be found. Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:42:53.047811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d589c3-d980-42f8-b555-9f8cd4c2de59 could not be found. Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d589c3-d980-42f8-b555-9f8cd4c2de59 could not be found. Aug 24 06:42:53.050031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:42:53.051297 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Returning 404 to user: Instance 62d589c3-d980-42f8-b555-9f8cd4c2de59 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:42:53.051297 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1de601c0-ce75-4ef7-aedf-a60808d97f59 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59" status: 404 len: 111 microversion: 2.1 time: 0.098408 Aug 24 06:42:53.051297 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 134/259] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:52 2022] GET /compute/v2.1/servers/62d589c3-d980-42f8-b555-9f8cd4c2de59 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:42:53.065601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:53.066468 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:53.070198 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:53.247058 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-645527781", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "networks": [{"uuid": "5b664d95-88fc-4b48-8784-4dfb9cc6e541"}]}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:53.329842 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] validate_networks() for [('5b664d95-88fc-4b48-8784-4dfb9cc6e541', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:42:53.346269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:53.363009 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9f0882b9-931b-44b7-a3b8-abcac8e2c8ca tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.342749 Aug 24 06:42:53.363673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 126/260] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:53 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:53.917783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:42:53.917783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:42:53.918273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:42:53.918678 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:42:53.919082 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:42:53.930445 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:53.930923 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:53.931560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:53.932298 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:53.932771 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:53.933219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:53.959367 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Getting quotas for project 2affaa1f6bef4cdcb559126588333d96. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:42:53.964714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Getting quotas for user bb4a45146170497098d2071618ea6469 and project 2affaa1f6bef4cdcb559126588333d96. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:42:53.980800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:42:53.983166 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:42:54.163090 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e01ce02c-d1b6-4c4c-8151-8a68781ab33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Action: 'create', calling method: .version_select at 0x7fb5d474c700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1329256554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINlWcz+xwQA+nzR0nDIW2UOIvjg+o3U8DnZpaxKLGzHzFRvTkzoFx9qfNyYQ/onwCpfEj3sNMfBtsil4OMhxUmKT9yW1kGXfOrbf3b35O0zruxQFQaqXWEaMRd7Dwkqww=="}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:54.178152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3e027f4c-f3ca-4dc7-a392-b26b422caaf3 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934904 Aug 24 06:42:54.179318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 135/261] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:42:54.195294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-40084c0c-73b5-460d-9cb8-f3fbfa12923a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:54.195294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-40084c0c-73b5-460d-9cb8-f3fbfa12923a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:54.196319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-e01ce02c-d1b6-4c4c-8151-8a68781ab33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Getting quotas for project a97277d100304d6aa689f73174562474. Resources: {'key_pairs'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:42:54.199562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-e01ce02c-d1b6-4c4c-8151-8a68781ab33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Getting quotas for user 594e9324c44540568a81fd5fdb980efb and project a97277d100304d6aa689f73174562474. Resources: {'key_pairs'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:42:54.319153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-40084c0c-73b5-460d-9cb8-f3fbfa12923a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:54.332483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-40084c0c-73b5-460d-9cb8-f3fbfa12923a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1213 microversion: 2.1 time: 0.145527 Aug 24 06:42:54.333752 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 136/262] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:54 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:54.395134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e01ce02c-d1b6-4c4c-8151-8a68781ab33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.455771 Aug 24 06:42:54.395134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 127/263] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:42:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:42:54.397222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:54.397959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:54.421516 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:54.422054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:54.422494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:54.423195 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:54.423654 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:54.424412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:54.630761 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:54.648238 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f6c61a0d-995c-44c1-996c-f7929130bd9e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1322 microversion: 2.1 time: 0.263159 Aug 24 06:42:54.662192 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 137/264] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:54 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:55.359093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c3c4870b-2676-40d2-b9ae-7d23df3ed0e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:55.360353 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c3c4870b-2676-40d2-b9ae-7d23df3ed0e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:55.470146 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c3c4870b-2676-40d2-b9ae-7d23df3ed0e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:55.476220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c3c4870b-2676-40d2-b9ae-7d23df3ed0e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1213 microversion: 2.1 time: 0.120080 Aug 24 06:42:55.483502 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 128/265] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:55 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:55.670502 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:55.671104 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:55.677258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:55.677823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:55.679485 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:55.680057 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:55.680630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:55.681236 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:55.884374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:55.893738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b45de714-9aa4-4d09-9f47-f8d0d67c2833 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1516 microversion: 2.1 time: 0.227629 Aug 24 06:42:55.894932 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 138/266] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:55 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:55.916318 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:42:55.919343 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:55.930062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:55.930717 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:55.931260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:55.932111 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:55.932680 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:55.933249 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:55.939703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:55.966994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lazy-loading 'flavor' on Instance uuid 4adfd4e5-f3c8-444f-99f9-d084d14aae09 {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:42:56.468465 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8b4daa50-d836-4ef1-9772-dc4ceee4652d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09/action" status: 200 len: 32 microversion: 2.1 time: 0.556653 Aug 24 06:42:56.469907 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 129/267] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:42:55 2022] POST /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09/action => generated 32 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:42:56.485054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:56.488361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:56.512087 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:56.514045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:56.516767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:56.519725 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:56.520421 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:56.522341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:56.524273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:56.528308 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:56.547620 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:56.555657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:56.555657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:56.555657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:56.555657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:56.556883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:56.821232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:56.841882 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a03485db-b2ce-4906-9a06-e56a012c1d44 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1265 microversion: 2.1 time: 0.341455 Aug 24 06:42:56.848344 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 130/268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:56 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:56.868484 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:56.886392 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cc2a2e2f-41d0-47fb-b120-4c2715c7d5e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.404953 Aug 24 06:42:56.887503 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 139/269] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:56 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:57.873898 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:57.874588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:57.897826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:57.899425 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:57.899915 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:57.900666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:57.901161 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:57.901566 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:57.909499 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:57.910115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:57.920142 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:57.920634 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:57.921162 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:57.922751 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:57.923281 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:57.923767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:58.072562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:58.081683 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-36e5591f-18cb-409b-ae1b-f75e5ae7d9e5 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1271 microversion: 2.1 time: 0.215523 Aug 24 06:42:58.085059 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 131/270] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:57 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:58.108240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:58.121433 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-331f3306-ae6c-4a07-8fe9-1e70313e9cb1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.215629 Aug 24 06:42:58.133373 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 140/271] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:57 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:42:59.123672 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:59.124429 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:59.136676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:59.137579 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:59.146194 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:42:59.147773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:42:59.151739 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:59.152671 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:59.155968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:59.156746 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:59.161879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:59.165949 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:59.169596 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:59.172117 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:59.176451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:59.177416 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:59.198606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:42:59.464618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:59.474095 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3b615554-55c2-4742-aaf5-1c751db27458 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.333943 Aug 24 06:42:59.475620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 141/272] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:59 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:42:59.536223 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:42:59.551677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0c8afc12-cf0f-4c0d-af73-714a174cc3d8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.433789 Aug 24 06:42:59.566377 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 132/273] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:42:59 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:00.208588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-7390cef6-cbcb-48f7-b36b-709a9b03707b req-636d6062-e888-4011-80f1-d305c36d738b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee632680-f4ed-463b-ad97-1fcac3a4ff13", "tag": "4a3aae8c-defe-48ba-9335-2f66056cf79a"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:00.227607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-7390cef6-cbcb-48f7-b36b-709a9b03707b req-636d6062-e888-4011-80f1-d305c36d738b service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:00.228371 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-7390cef6-cbcb-48f7-b36b-709a9b03707b req-636d6062-e888-4011-80f1-d305c36d738b service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:00.229600 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-7390cef6-cbcb-48f7-b36b-709a9b03707b req-636d6062-e888-4011-80f1-d305c36d738b service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:00.244437 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-7390cef6-cbcb-48f7-b36b-709a9b03707b req-636d6062-e888-4011-80f1-d305c36d738b service nova] Creating event network-changed:4a3aae8c-defe-48ba-9335-2f66056cf79a for instance ee632680-f4ed-463b-ad97-1fcac3a4ff13 on hv-cinder-85427 Aug 24 06:43:00.255065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-7390cef6-cbcb-48f7-b36b-709a9b03707b req-636d6062-e888-4011-80f1-d305c36d738b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047059 Aug 24 06:43:00.255065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 142/274] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:00.499401 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:00.500360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:00.508707 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:00.509390 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:00.513695 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:00.519339 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:00.519339 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:00.519605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:00.576298 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:00.576996 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:00.585614 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:00.593248 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:00.593248 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:00.593248 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:00.593248 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:00.593635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:01.060293 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:01.088017 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-bc63c54c-ade8-4838-ab3e-56826cd22d35 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.515967 Aug 24 06:43:01.089917 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 143/275] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:00 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:01.185254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:01.193820 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e2a6f00c-b6a2-4f3a-8e80-24fff34c660c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.699991 Aug 24 06:43:01.194700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 133/276] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:00 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:02.114605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:02.115238 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:02.126876 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:02.127779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:02.128502 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:02.129750 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:02.130551 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:02.131405 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:02.226155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:02.227423 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:02.241257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:02.244133 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:02.244820 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:02.246197 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:02.248950 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:02.249494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:02.339276 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:02.359375 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7bdc8759-faea-4d45-bc2a-b03ee304fb6a tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.251787 Aug 24 06:43:02.361329 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 144/277] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:02 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:02.432071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:02.447532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fce5826f-ba1b-42d6-a2f1-9e70ccb7d617 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.234128 Aug 24 06:43:02.453982 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 134/278] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:02 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:03.383512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:03.384327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:03.391729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:03.392223 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:03.392659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:03.393398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:03.394120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:03.394279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:03.480471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:03.481797 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:03.486285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:03.489768 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:03.490509 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:03.490998 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:03.492220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:03.492669 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:03.493463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:03.600406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:03.615961 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b14a623e-4ee1-4f49-a000-d9798ce6c8e8 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.235983 Aug 24 06:43:03.617373 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 145/279] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:03 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:03.702131 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:03.737755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-eeb747b2-ecf0-44ac-80bc-37bae7ffbc1d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.263042 Aug 24 06:43:03.738972 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 135/280] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:03 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:04.637476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:04.638136 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:04.640516 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:04.642759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=8 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:04.655148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:04.656839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:04.657483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:04.661280 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:04.662902 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:04.663943 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:04.766083 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:04.766831 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:04.774943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:04.775448 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:04.775890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:04.776670 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:04.777144 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:04.777586 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:04.917608 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:04.941900 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e11e6fe1-43ca-46e2-8a72-013baf0fb1c9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.306071 Aug 24 06:43:04.943953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 146/281] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:04 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:05.476125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=6 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:05.513726 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:05.537974 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b65b6aba-b7d5-40a3-a7f7-051358761d8f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.772816 Aug 24 06:43:05.537974 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 136/282] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:04 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:05.968032 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:05.969604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:05.977371 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:05.979049 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:05.979688 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:05.980868 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:05.981529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:05.982138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:06.201980 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:06.212926 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-12ec7697-7810-4e32-914d-06cb3e976397 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.249964 Aug 24 06:43:06.227432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 147/283] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:05 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:06.561623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:06.563406 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:06.574339 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:06.575009 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:06.575482 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:06.576494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:06.576964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:06.577424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:06.988382 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:07.000322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ecdc97a7-9026-4b16-9692-1250aa171af9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.442253 Aug 24 06:43:07.001800 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 137/284] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:06 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:07.238382 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:07.239108 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:07.245357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:07.246013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:07.246812 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:07.247167 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:07.249028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:07.249028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:07.440683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:07.456585 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-73e463df-7539-4983-b9ba-835bbf244c12 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.221215 Aug 24 06:43:07.456585 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 148/285] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:07 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:08.025574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:08.026262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:08.033662 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:08.034280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:08.034788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:08.035677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:08.036370 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:08.036935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:08.252358 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:08.268185 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d359c584-f90f-4bcb-83fe-e72dd0518d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.248854 Aug 24 06:43:08.268780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 138/286] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:08 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:08.380969 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-0f4a0c0c-a31c-48f3-8ff7-3d9ad1097265 req-ef525f6f-0e50-4896-84a6-bcc870cd9bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee632680-f4ed-463b-ad97-1fcac3a4ff13", "name": "network-vif-plugged", "status": "completed", "tag": "4a3aae8c-defe-48ba-9335-2f66056cf79a"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:08.393092 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-0f4a0c0c-a31c-48f3-8ff7-3d9ad1097265 req-ef525f6f-0e50-4896-84a6-bcc870cd9bce service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:08.393713 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-0f4a0c0c-a31c-48f3-8ff7-3d9ad1097265 req-ef525f6f-0e50-4896-84a6-bcc870cd9bce service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:08.395423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-0f4a0c0c-a31c-48f3-8ff7-3d9ad1097265 req-ef525f6f-0e50-4896-84a6-bcc870cd9bce service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:08.407504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-0f4a0c0c-a31c-48f3-8ff7-3d9ad1097265 req-ef525f6f-0e50-4896-84a6-bcc870cd9bce service nova] Creating event network-vif-plugged:4a3aae8c-defe-48ba-9335-2f66056cf79a for instance ee632680-f4ed-463b-ad97-1fcac3a4ff13 on hv-cinder-85427 Aug 24 06:43:08.414643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-0f4a0c0c-a31c-48f3-8ff7-3d9ad1097265 req-ef525f6f-0e50-4896-84a6-bcc870cd9bce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038578 Aug 24 06:43:08.416004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 149/287] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:43:08.479830 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:08.480681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:08.488789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:08.489873 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:08.491144 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:08.492303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:08.492777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:08.493482 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:08.834411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:08.849148 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-090101cd-61d1-4869-a03a-6b923c6fa3cf tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.373643 Aug 24 06:43:08.863959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 139/288] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:08 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:09.291192 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:09.292611 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:09.304152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:09.304929 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:09.305571 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:09.307017 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:09.308022 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:09.308954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:09.518001 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:09.529081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-20ad9a4c-f08b-4cc2-a92e-0d858868110a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.242718 Aug 24 06:43:09.529903 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 150/289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:09 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:09.877503 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:09.879250 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:09.888486 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:09.888998 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:09.889648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:09.894922 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:09.899525 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:09.900452 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:10.182963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:10.190516 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0c6d0093-2f4e-4d9b-b46b-5c686d1fccc9 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.318109 Aug 24 06:43:10.191107 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 140/290] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:09 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:10.553771 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:10.556268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:10.564849 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:10.565376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:10.565808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:10.566932 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:10.567727 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:10.568766 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:10.712399 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:10.720611 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-80cefb8b-b06f-4ed7-8910-c45c105ba6e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.171976 Aug 24 06:43:10.721426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 151/291] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:10 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:11.219065 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:11.219065 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:11.221464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:11.221952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:11.222389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:11.223081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:11.223536 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:11.223947 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:11.448049 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:11.456705 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-59485546-94ae-485a-953b-4334af58a096 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.246641 Aug 24 06:43:11.458074 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 141/292] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:11 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:11.742833 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:11.744326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:11.754523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:11.761435 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:11.761435 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:11.761435 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:11.761435 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:11.761963 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:11.975258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:11.987097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c9d144a6-7e36-415b-bf3a-d473f9b776dc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.248142 Aug 24 06:43:11.988055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 152/293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:11 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:12.482240 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:12.483703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:12.492208 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:12.496921 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:12.497411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:12.498324 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:12.498982 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:12.499691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:12.695850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:12.709953 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1c1ea503-cb3f-421e-be5c-f7d0aca116f7 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.227166 Aug 24 06:43:12.711038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 142/294] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:12 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:13.009493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:13.010654 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:13.017263 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:13.022425 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:13.022425 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:13.022425 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:13.022425 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:13.022815 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:13.447047 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:13.459619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-68ed0aa6-34cd-4618-9e77-3417e3658ee0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.452195 Aug 24 06:43:13.469841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 153/295] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:13 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:13.738199 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:13.739086 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:13.749944 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:13.750668 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:13.751322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:13.752102 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:13.752556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:13.753136 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:13.934466 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:13.940309 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:13.951301 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-74d03b2a-8027-4561-b0ed-a19a6f224136 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.211415 Aug 24 06:43:13.952044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 143/296] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:13 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:14.479264 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:14.480783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:14.486726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:14.487211 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:14.487665 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:14.488337 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:14.488783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:14.489222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:14.639911 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:14.652521 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9368f8b1-a644-47bd-9f3c-dbfc3ff8dcaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.177233 Aug 24 06:43:14.653774 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 154/297] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:14 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:14.975281 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:14.975887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:14.986253 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:14.986253 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:14.986253 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:14.986253 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:14.986792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:14.986792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:15.180120 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:15.192395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-37aedd1b-4df7-468f-b650-d53490054590 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.218492 Aug 24 06:43:15.194511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 144/298] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:14 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:15.676809 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:15.679127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:15.685714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:15.686471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:15.687070 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:15.687934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:15.688549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:15.689122 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:15.889620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:15.904557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1e9eb1f1-3c05-4f58-9ab9-13c3ea24c7b8 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.234432 Aug 24 06:43:15.906394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 155/299] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:15 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:16.223626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:16.226699 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:16.245925 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:16.249305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:16.249747 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:16.258620 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:16.259851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:16.260549 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:16.473393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:16.483712 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c94c1615-8c81-461f-87df-db921fb70eb6 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.273171 Aug 24 06:43:16.485138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 145/300] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:16 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:16.927044 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:16.927556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:16.934770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:16.936540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:16.936540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:16.937251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:16.937913 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:16.938392 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:17.101475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:17.117676 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-272a11fc-f6e1-4437-ab69-00654aba1454 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.193985 Aug 24 06:43:17.119147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 156/301] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:16 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:17.506848 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:17.508016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:17.520895 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:17.522431 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:17.523107 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:17.523971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:17.524572 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:17.525373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:17.721645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:17.740689 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d79e3972-7708-41c4-ab4f-07ad052e8fef tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1313 microversion: 2.1 time: 0.232796 Aug 24 06:43:17.740689 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 146/302] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:17 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:18.139738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:18.140370 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:18.142332 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:18.147290 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:18.147601 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:18.148022 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:18.148711 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:18.149154 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:18.149585 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:18.289094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:18.301274 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d73e4b46-6dce-445a-9be0-4e6328ebdb2d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.165252 Aug 24 06:43:18.301984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 157/303] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:18 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:18.759405 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:18.760367 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:18.768665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:18.769303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:18.769743 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:18.770657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:18.771214 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:18.774030 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:18.963760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:18.975211 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-305d01a9-77b4-4166-9c35-89923e98fc5d tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1498 microversion: 2.1 time: 0.222144 Aug 24 06:43:18.976129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 147/304] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:18 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1498 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:19.325934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:19.327130 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:19.345309 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:19.346467 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:19.347942 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:19.351101 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:19.351787 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:19.352994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:19.538024 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:19.546436 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c2357d34-ae4c-43e5-b172-02b7e1a0335d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.224647 Aug 24 06:43:19.547261 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 158/305] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:19 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:20.299709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:20.302753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:20.311729 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:20.312526 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:20.313134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:20.314086 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:20.314700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:20.315294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:20.346167 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:43:20.570317 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:20.571570 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:20.578665 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:20.579290 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:20.579717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:20.580417 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:20.580858 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:20.581314 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:20.584754 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:20.743138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9f5af66f-9eb7-4ef7-b887-276207c2105c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 204 len: 0 microversion: 2.1 time: 0.447032 Aug 24 06:43:20.744319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 148/306] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:43:20 2022] DELETE /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:43:20.753371 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:20.754206 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:20.764603 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:20.765576 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:20.766143 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:20.766997 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:20.767685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:20.768261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:20.789431 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:20.799172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a8172c4f-b610-4fd2-96cf-ecd9cbde4b02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.234200 Aug 24 06:43:20.800135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 159/307] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:20 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:20.955790 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:20.970391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c6bc2c07-164c-47e8-b7e4-123f164c0d4b tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1504 microversion: 2.1 time: 0.221318 Aug 24 06:43:20.971121 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 149/308] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:20 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:21.826310 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:21.826310 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:21.831308 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:21.832181 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:21.835080 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:21.836662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:21.837267 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:21.837805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:21.995609 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:21.995859 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:21.996481 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:22.007186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:22.007673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:22.008008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8c8ddf94-17fc-4e9f-8693-0c8037d51e27 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.191892 Aug 24 06:43:22.008117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:22.009228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:22.009417 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 160/309] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:21 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:22.009504 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:22.009753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:22.164345 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:22.172653 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-797bd89e-b889-429a-b994-641de212314c tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1504 microversion: 2.1 time: 0.184124 Aug 24 06:43:22.173506 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 150/310] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:21 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:23.028053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:23.028656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:23.034705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:23.036924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:23.036924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:23.036924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:23.036924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:23.037360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:23.170429 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:23.179049 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-62930089-eec8-477b-9854-6072c8069d88 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.154616 Aug 24 06:43:23.179869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 161/311] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:23 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:23.195252 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:23.195975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:23.202467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:23.202917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:23.203345 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:23.204030 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:23.204473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:23.204888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:23.375474 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9be6ccf2-a0c9-4472-b102-850ea6f491d0 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Action: 'create', calling method: .version_select at 0x7fb5d4a03550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1126781627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw3ZQXedypY3UopB39U8swgkNzuXjD6jDtNKeAXLKGXjeiU5MwFSsDKtI28rASIFXi9pMUgPvxY7b1uKfGZ+8lU7KvDM3p3bvto0ijsgNpW/RiQqBrj9oEAU6Ldk8XErg=="}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:23.391863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-9be6ccf2-a0c9-4472-b102-850ea6f491d0 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Getting quotas for project e36bdfb532924d8ebe001112e285fcdc. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:23.395901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-9be6ccf2-a0c9-4472-b102-850ea6f491d0 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Getting quotas for user fc1fefc915e941628a01336564368f81 and project e36bdfb532924d8ebe001112e285fcdc. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:23.432827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:23.441110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1fdcd51c-0a99-469e-a27a-cae838472a6e tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1504 microversion: 2.1 time: 0.250532 Aug 24 06:43:23.453464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 151/312] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:23 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:23.509011 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9be6ccf2-a0c9-4472-b102-850ea6f491d0 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.137547 Aug 24 06:43:23.509642 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 162/313] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:43:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:43:23.565387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-667606840", "imageRef": "e27e8aba-0606-46a1-ad94-cb059f4b7d45", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1126781627", "networks": [{"uuid": "596561df-ab9a-450d-928b-4f2b2c3ee764"}]}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:23.630094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] validate_networks() for [('596561df-ab9a-450d-928b-4f2b2c3ee764', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:43:23.968348 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-a289e6ed-3d66-4c29-93a6-649fec7335e1 req-924b41dc-1a2e-4d63-aa19-3197360e088a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee632680-f4ed-463b-ad97-1fcac3a4ff13", "name": "network-vif-deleted", "tag": "4a3aae8c-defe-48ba-9335-2f66056cf79a"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:23.979067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a289e6ed-3d66-4c29-93a6-649fec7335e1 req-924b41dc-1a2e-4d63-aa19-3197360e088a service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:23.979561 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a289e6ed-3d66-4c29-93a6-649fec7335e1 req-924b41dc-1a2e-4d63-aa19-3197360e088a service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:23.979987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a289e6ed-3d66-4c29-93a6-649fec7335e1 req-924b41dc-1a2e-4d63-aa19-3197360e088a service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:23.992517 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-a289e6ed-3d66-4c29-93a6-649fec7335e1 req-924b41dc-1a2e-4d63-aa19-3197360e088a service nova] Creating event network-vif-deleted:4a3aae8c-defe-48ba-9335-2f66056cf79a for instance ee632680-f4ed-463b-ad97-1fcac3a4ff13 on hv-cinder-85427 Aug 24 06:43:23.998529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-a289e6ed-3d66-4c29-93a6-649fec7335e1 req-924b41dc-1a2e-4d63-aa19-3197360e088a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034980 Aug 24 06:43:23.998719 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 163/314] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:24.138619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:43:24.139110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:43:24.139677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:43:24.140088 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:43:24.140489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:43:24.151792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:24.152297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:24.152726 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:24.153473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:24.153929 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:24.154343 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:24.173880 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Getting quotas for project e36bdfb532924d8ebe001112e285fcdc. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:24.177943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Getting quotas for user fc1fefc915e941628a01336564368f81 and project e36bdfb532924d8ebe001112e285fcdc. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:24.193868 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:43:24.196939 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e27e8aba-0606-46a1-ad94-cb059f4b7d45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:43:24.201644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:24.202322 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:24.211834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:24.211834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:24.211834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:24.211834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:24.212251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:24.212251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:24.327117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8dbab365-e0fd-4f47-94d4-7204ef485920 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765660 Aug 24 06:43:24.328163 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 152/315] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:43:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:43:24.341069 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a6ea14e1-ab8f-4d21-88fc-b6165dfb7af9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:24.341827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a6ea14e1-ab8f-4d21-88fc-b6165dfb7af9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:24.389814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:24.399184 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-04b2ff2a-728c-484b-9c9c-73cb7c323660 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.202113 Aug 24 06:43:24.399872 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 164/316] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:24 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:24.415730 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a6ea14e1-ab8f-4d21-88fc-b6165dfb7af9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:24.423687 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a6ea14e1-ab8f-4d21-88fc-b6165dfb7af9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1258 microversion: 2.1 time: 0.087846 Aug 24 06:43:24.424266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 153/317] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:24 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:24.464450 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:24.465669 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:24.472064 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:24.472542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:24.473828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:24.473828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:24.474158 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:24.474733 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:24.646250 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:24.646900 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:24.647641 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:24.648090 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lazy-loading 'fault' on Instance uuid ee632680-f4ed-463b-ad97-1fcac3a4ff13 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:43:24.689282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4a45146170497098d2071618ea6469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2affaa1f6bef4cdcb559126588333d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:24.702180 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-bfbc049b-4fa0-47ab-b826-5b53e8f29cce tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 200 len: 1303 microversion: 2.1 time: 0.238121 Aug 24 06:43:24.702180 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 165/318] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:24 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 1303 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:25.422187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:25.424223 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:25.430456 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:25.430964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:25.431495 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:25.432284 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:25.432805 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:25.433261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:25.453558 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-dfc88f71-f148-4818-bc5e-bdeb5670f5bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:25.454178 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-dfc88f71-f148-4818-bc5e-bdeb5670f5bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:25.519390 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-dfc88f71-f148-4818-bc5e-bdeb5670f5bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:25.526942 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-dfc88f71-f148-4818-bc5e-bdeb5670f5bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1258 microversion: 2.1 time: 0.078178 Aug 24 06:43:25.527626 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 166/319] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:25 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:25.577310 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:25.586631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ea2f0fe2-dab3-4c40-9b4d-45f449e859a5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.169078 Aug 24 06:43:25.587236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 154/320] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:25 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:25.720116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:25.720719 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] [instance: ee632680-f4ed-463b-ad97-1fcac3a4ff13] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:25.727907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:25.728625 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:25.729062 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:25.729794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:25.730243 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:25.730658 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:25.745489 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] HTTP exception thrown: Instance ee632680-f4ed-463b-ad97-1fcac3a4ff13 could not be found. Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Request method failure captured: Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 HTTP/1.1 Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcg9mNQNfifNrJtQAqHCr9yxEnOS-tMgHwGJbF7zrDHkH4viQtVSSf3TYhR0_Ono0b8xzwwka_ebgjbKpYPb2iVygkWkH5dvcVDnB2vFwA7TpT9X9Nlk3kSSsFJxluKJnXMQVwFn8fnfzwfCrVg_9Oh52CLWhv-q6Ogbi_mbUIKcfJM Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 2affaa1f6bef4cdcb559126588333d96 Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-VolumesActionsTest-1465906438 Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:43:25.747153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2affaa1f6bef4cdcb559126588333d96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2affaa1f6bef4cdcb559126588333d96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2affaa1f6bef4cdcb559126588333d96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2affaa1f6bef4cdcb559126588333d96", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-VolumesActionsTest-1465906438 Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 2affaa1f6bef4cdcb559126588333d96 Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-VolumesActionsTest-1465906438 Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-VolumesActionsTest-1465906438-project Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: bb4a45146170497098d2071618ea6469 Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-VolumesActionsTest-1465906438-project Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance ee632680-f4ed-463b-ad97-1fcac3a4ff13 could not be found. Aug 24 06:43:25.748723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': 'ee632680-f4ed-463b-ad97-1fcac3a4ff13'} Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee632680-f4ed-463b-ad97-1fcac3a4ff13 could not be found. Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:43:25.749593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee632680-f4ed-463b-ad97-1fcac3a4ff13 could not be found. Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee632680-f4ed-463b-ad97-1fcac3a4ff13 could not be found. Aug 24 06:43:25.751410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:43:25.752597 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] Returning 404 to user: Instance ee632680-f4ed-463b-ad97-1fcac3a4ff13 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:43:25.752597 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-922ebc9e-bfcd-445b-8c3b-d57b66770028 tempest-VolumesActionsTest-1465906438 tempest-VolumesActionsTest-1465906438-project] 10.222.0.47 "GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13" status: 404 len: 111 microversion: 2.1 time: 0.032533 Aug 24 06:43:25.752597 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 167/321] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:25 2022] GET /compute/v2.1/servers/ee632680-f4ed-463b-ad97-1fcac3a4ff13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:43:26.548180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:26.548943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:26.556408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:26.557326 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:26.558122 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:26.558859 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:26.559359 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:26.559776 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:26.608920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:26.611299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:26.616605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:26.617095 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:26.617717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:26.618617 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:26.619063 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:26.619474 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:26.656289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:26.665258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b7c9e6ea-61b7-4ca8-a200-e6fd9270ce7c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1310 microversion: 2.1 time: 0.120846 Aug 24 06:43:26.667202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 155/322] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:26 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1310 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:26.783863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:26.796397 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-81734b54-eb01-4749-ad98-4a50d4311788 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.191720 Aug 24 06:43:26.796977 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 168/323] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:26 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:27.687627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:27.688378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:27.696173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:27.696780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:27.698041 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:27.698165 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:27.698683 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:27.699188 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:27.774910 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:27.789035 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f088d6c0-bd7a-4644-be82-f3bdafe7100e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1316 microversion: 2.1 time: 0.103450 Aug 24 06:43:27.790096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 156/324] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:27 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1316 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:27.820773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:27.821756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:27.827979 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:27.828467 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:27.829069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:27.830061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:27.830828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:27.831294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:28.003387 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:28.013580 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3f138eb9-2441-4d96-a548-9905281f1004 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.198847 Aug 24 06:43:28.014149 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 169/325] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:27 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:28.813696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:28.814529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:28.823353 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:28.824149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:28.826311 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:28.827257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:28.827919 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:28.828668 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:29.035247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:29.036584 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:29.044421 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:29.045444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:29.046114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:29.047045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:29.047739 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:29.048756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:29.051169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:29.064235 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2aa6bf0e-e4ef-420a-a868-c84a2305c377 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.254096 Aug 24 06:43:29.070596 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 157/326] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:28 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:29.248376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:29.260940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6e561419-9237-4d1d-8c89-900778eb2a02 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.229334 Aug 24 06:43:29.262265 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 170/327] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:29 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:29.510463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-6cc83efb-b107-4151-80f5-0df17ef962e4 req-6188abaa-a818-44c9-9e5a-c61d3b8edddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed98f99-0b60-4284-b252-931aa0e4adcc", "tag": "4c9b237a-0d94-4b19-8954-bbc3140f2b84"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:29.526590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-6cc83efb-b107-4151-80f5-0df17ef962e4 req-6188abaa-a818-44c9-9e5a-c61d3b8edddc service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:29.527350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-6cc83efb-b107-4151-80f5-0df17ef962e4 req-6188abaa-a818-44c9-9e5a-c61d3b8edddc service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:29.527942 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-6cc83efb-b107-4151-80f5-0df17ef962e4 req-6188abaa-a818-44c9-9e5a-c61d3b8edddc service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:29.542944 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-6cc83efb-b107-4151-80f5-0df17ef962e4 req-6188abaa-a818-44c9-9e5a-c61d3b8edddc service nova] Creating event network-changed:4c9b237a-0d94-4b19-8954-bbc3140f2b84 for instance 3ed98f99-0b60-4284-b252-931aa0e4adcc on hv-cinder-85427 Aug 24 06:43:29.550283 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-6cc83efb-b107-4151-80f5-0df17ef962e4 req-6188abaa-a818-44c9-9e5a-c61d3b8edddc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043984 Aug 24 06:43:29.551093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 158/328] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:30.091573 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:30.092236 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:30.098629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:30.099114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:30.099542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:30.101718 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:30.102518 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:30.103104 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:30.262032 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:30.272793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-42186840-f6bd-4aca-92a2-459400a20855 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.184122 Aug 24 06:43:30.274139 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 171/329] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:30 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:30.294604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:30.295314 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:30.302294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:30.303092 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:30.303692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:30.314327 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:30.322017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:30.322816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:30.526822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:30.544751 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5c626d2c-e678-43fc-93cd-6807c1067ade tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.257784 Aug 24 06:43:30.546063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 159/330] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:30 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:31.299266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:31.299925 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:31.308769 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:31.309636 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:31.310591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:31.311997 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:31.312960 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:31.313432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:31.500306 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:31.510843 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-338ce52c-7c30-4101-8bee-8b23d16810ab tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.215440 Aug 24 06:43:31.511579 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 172/331] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:31 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:31.570558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:31.572118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:31.597345 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:31.597938 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:31.598583 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:31.599428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:31.600632 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:31.601458 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:31.778706 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:31.789686 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fe5ee433-874b-4e02-9b64-974e4ec96076 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.225722 Aug 24 06:43:31.791285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 160/332] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:31 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:32.532023 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:32.532747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:32.539792 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:32.540403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:32.541029 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:32.541940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:32.542397 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:32.542948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:32.682344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:32.690326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2e833945-1f6e-4b26-9561-23d359a9af0d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.162494 Aug 24 06:43:32.690964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 173/333] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:32 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:32.813378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:32.814031 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:32.821526 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:32.822039 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:32.822586 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:32.823283 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:32.823790 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:32.824149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:32.828659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:32.956708 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:32.964760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6947e733-0ce5-4845-ae3a-41abdb934e8a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.155510 Aug 24 06:43:32.965360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 161/334] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:32 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:33.713512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:33.729477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:33.729477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:33.729477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:33.729477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:33.730770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:33.730770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:33.730770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:33.883915 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:33.891647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e601f1f6-6b6f-447b-8001-314fa3e15261 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.183448 Aug 24 06:43:33.892201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 174/335] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:33 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:33.994361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:33.995532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:34.005917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:34.007382 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:34.008145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:34.009816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:34.010612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:34.011344 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:34.153695 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:34.165590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-efac316e-6a8e-441a-be2f-18bbb1b557d3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.176229 Aug 24 06:43:34.166237 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 162/336] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:33 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:34.913299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:34.913882 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:34.920477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:34.921164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:34.921652 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:34.922414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:34.922936 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:34.923424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:35.091760 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:35.101107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-864a16e1-7db3-4125-822c-8e24a9266937 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.191001 Aug 24 06:43:35.101752 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 175/337] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:34 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:35.187267 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:35.187920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:35.189907 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:35.190705 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=8 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:35.208362 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:35.208972 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:35.209645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:35.210420 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:35.210942 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:35.211470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:35.637274 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:35.654291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4b1214bf-7df4-4127-b7ae-1c54f84a8882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.467147 Aug 24 06:43:35.661062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 163/338] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:35 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:36.124870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:36.127542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:36.142928 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=6 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:36.145659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:36.146465 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:36.148185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:36.149753 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:36.150443 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:36.151218 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:36.419731 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:36.430649 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1ba1b944-a51f-4ad5-b15f-621caeda3f47 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.311273 Aug 24 06:43:36.432187 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 176/339] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:36 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:36.684216 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:36.684635 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:36.693294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:36.694977 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:36.695751 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:36.696822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:36.697572 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:36.698193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:37.029383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:37.029383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-be42cd8f-785c-4c63-bea1-09bb4f01fdae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.263853 Aug 24 06:43:37.029383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 164/340] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:36 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:37.363212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1254213964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1329256554", "security_groups": [{"name": "tempest-secgroup-smoke-1486398605"}], "block_device_mapping_v2": [{"uuid": "50bc538f-df62-4dfb-bcc8-8f931889fd9f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "27d7c166-db17-4e73-a5c2-606d6229bd9b"}]}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:37.457597 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:37.458538 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:37.480004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:37.480881 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:37.481547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:37.482542 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:37.483247 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:37.483836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:37.621079 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] validate_networks() for [('27d7c166-db17-4e73-a5c2-606d6229bd9b', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:43:37.833076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:37.841600 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-370457ed-7dc8-4703-8211-7af847ce5f95 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.388176 Aug 24 06:43:37.842175 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 165/341] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:37 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:37.968042 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:37.968647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:37.983179 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:37.987477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:37.987933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:37.988685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:37.989147 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:37.989593 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:38.407069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:43:38.408876 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:43:38.409741 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:43:38.410460 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:43:38.411074 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:43:38.426172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:38.426172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:38.426172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:38.426172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:38.426635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:38.426635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:38.445603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Getting quotas for project a97277d100304d6aa689f73174562474. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:38.450275 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Getting quotas for user 594e9324c44540568a81fd5fdb980efb and project a97277d100304d6aa689f73174562474. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:38.552788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:43:38.552788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50bc538f-df62-4dfb-bcc8-8f931889fd9f',volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:43:38.566682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:38.576056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8340b9af-af8e-47b2-954d-d5e47071d1b9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.611849 Aug 24 06:43:38.576629 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 166/342] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:37 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:38.867995 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:38.869500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:38.877726 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:38.884523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:38.888463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:38.889514 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:38.890621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:38.894236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:38.894946 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:39.109252 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c394811e-4a6b-4113-a2ae-d966eff71813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.749667 Aug 24 06:43:39.112026 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 177/343] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:43:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:43:39.129109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-13123c14-1c00-412a-8e36-fb9a52999a0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:39.130880 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-13123c14-1c00-412a-8e36-fb9a52999a0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:39.317761 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-13123c14-1c00-412a-8e36-fb9a52999a0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:39.323430 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:39.334484 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cd9c454f-e193-4725-b513-6ef1ab0e00a4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.470399 Aug 24 06:43:39.336381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 167/344] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:38 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:39.357295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-13123c14-1c00-412a-8e36-fb9a52999a0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1095 microversion: 2.1 time: 0.235543 Aug 24 06:43:39.370592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 178/345] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:39 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1095 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:39.598496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:39.599445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:39.607805 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:39.608601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:39.609325 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:39.610309 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:39.611011 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:39.611667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:39.800565 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:39.811207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b15d86a1-01e7-4226-8d97-2d969daf059a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.217193 Aug 24 06:43:39.811826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 168/346] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:39 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:40.379505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:40.380177 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:40.396122 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:40.396433 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:40.397434 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:40.398387 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:40.398853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:40.402742 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:40.447915 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b8fa25ff-2d86-430a-97f8-4c43f58f5d85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:40.450127 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b8fa25ff-2d86-430a-97f8-4c43f58f5d85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:40.696125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b8fa25ff-2d86-430a-97f8-4c43f58f5d85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:40.705779 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b8fa25ff-2d86-430a-97f8-4c43f58f5d85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1095 microversion: 2.1 time: 0.284330 Aug 24 06:43:40.721920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 169/347] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:40 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1095 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:40.835267 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:40.842284 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:40.843912 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:40.847193 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3e5ac165-96ea-4b06-831a-debabb89012b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.472894 Aug 24 06:43:40.848119 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 179/348] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:40 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:40.862343 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:40.864098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:40.865032 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:40.867253 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:40.869685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:40.870359 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:41.045484 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:41.054986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e111b690-0201-4f47-94a1-a76e1d4e475e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.220293 Aug 24 06:43:41.056123 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 170/349] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:40 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:41.729918 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:41.731216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:41.737640 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:41.738583 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:41.739022 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:41.740153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:41.741105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:41.742359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:41.766729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:41.819921 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:41.829216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-841ec6c1-c745-4555-9961-f9f57ecbd4a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1145 microversion: 2.1 time: 0.103408 Aug 24 06:43:41.832704 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 180/350] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:41 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:41.876871 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:41.876871 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:41.879920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:41.880401 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:41.880827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:41.881571 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:41.882073 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:41.882799 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:42.049838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:42.059775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9d16be9f-889d-47b7-b5d5-2504d1ca839f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.191164 Aug 24 06:43:42.060355 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 171/351] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:41 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:42.079980 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:42.080591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:42.088659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:42.089142 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:42.089608 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:42.090308 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:42.090930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:42.091343 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:42.240270 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:42.242828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-80f8e5c1-d5c1-49a1-9edc-f26b32f58a1b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.166722 Aug 24 06:43:42.243394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 181/352] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:42 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:42.852414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:42.853153 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:42.859672 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:42.860223 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:42.860625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:42.870305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:42.870916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:42.881500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:42.956819 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:42.969474 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1f5ef6af-328c-47da-8978-d31ac8e77c23 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1145 microversion: 2.1 time: 0.120681 Aug 24 06:43:42.970840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 172/353] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:42 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1145 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:43.081881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:43.083201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:43.102627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:43.109737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:43.110284 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:43.111102 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:43.111627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:43.112351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:43.267086 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:43.267968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:43.280623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:43.281116 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:43.291206 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:43.292980 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:43.294079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:43.294694 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:43.301036 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:43.312769 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-486e43ad-9184-4900-8405-6d522e35a556 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.234626 Aug 24 06:43:43.314539 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 182/354] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:43 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:43.487584 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:43.500357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5f0e62e6-70e1-4198-b805-46af6b7b0c3d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.240469 Aug 24 06:43:43.514175 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 173/355] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:43 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:43.999835 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:44.000440 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:44.006890 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:44.007857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:44.008619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:44.010616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:44.011146 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:44.011801 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:44.099180 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:44.111006 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b974ebcc-d65f-4e80-bbbf-8505797f164d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1145 microversion: 2.1 time: 0.114573 Aug 24 06:43:44.120831 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 183/356] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:43 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1145 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:44.337157 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:44.337791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:44.347029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:44.348037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:44.353661 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:44.354620 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:44.355242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:44.355969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:44.525672 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:44.526268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:44.547076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:44.550224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:44.550224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:44.550224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:44.557633 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:44.558517 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:44.672146 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:44.682595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5b9c1dd4-fe76-47c9-96cd-2b066f50a4d9 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.349975 Aug 24 06:43:44.683244 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 174/357] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:44 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:44.833681 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:44.843080 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7e9a6039-35cf-40b3-a615-7e9875eab6ac tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.322442 Aug 24 06:43:44.846218 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 184/358] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:44 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:45.134001 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:45.135251 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:45.141503 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:45.142207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:45.142792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:45.143480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:45.143927 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:45.144349 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:45.230889 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:45.252067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7e255164-d2f2-4b77-bb9f-3fd6bcc4ad05 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1137 microversion: 2.1 time: 0.122786 Aug 24 06:43:45.252658 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 175/359] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:45 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1137 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:45.703860 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:45.704480 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:45.711470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:45.711945 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:45.712370 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:45.713082 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:45.713592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:45.714030 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:45.859949 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:45.869121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c5055701-f689-4e34-be6b-ae4eaaf6a7d1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.169074 Aug 24 06:43:45.870227 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 185/360] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:45 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:45.871912 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:45.872807 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:45.880704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:45.881705 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:45.883100 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:45.884148 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:45.884883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:45.885589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:46.079658 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:46.098116 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c20b3153-d5a0-4963-96f5-1a4e1ba3ce85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.231861 Aug 24 06:43:46.113573 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 176/361] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:45 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:46.280362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:46.281812 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:46.292893 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:46.295832 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:46.295832 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:46.296480 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:46.297657 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:46.298919 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:46.416369 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:46.429170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-55ec7cf8-e1d4-48df-9f33-74a72f6c9da4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1137 microversion: 2.1 time: 0.157650 Aug 24 06:43:46.430361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 186/362] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:46 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1137 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:46.897037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:46.897968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:46.910002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:46.913413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:46.915457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:46.917454 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:46.918098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:46.919977 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:47.125916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:47.126734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:47.133661 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:47.144539 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:47.145774 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:47.146414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:47.147809 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:47.147924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:47.379691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:47.391631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5ca27e18-797c-4f80-9325-8e3d5aa6022c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.498766 Aug 24 06:43:47.396623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 177/363] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:46 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:47.406412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:47.415321 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-66ae7f79-8a42-4a09-a758-cd4a936bb0ea tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.293696 Aug 24 06:43:47.418451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 187/364] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:47 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:47.454424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:47.456007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:47.467111 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:47.468268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:47.469035 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:47.470369 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:47.471137 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:47.471715 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:47.554304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:47.558703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=100 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:47.570860 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ffd42759-0a7e-4b0e-8084-9872724a9390 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1193 microversion: 2.1 time: 0.121004 Aug 24 06:43:47.572608 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 178/365] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:47 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:48.423848 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:48.425594 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:48.433699 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:48.446257 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.446257 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.446257 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.446257 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.446690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.446780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:48.447215 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.447308 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:48.466185 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.466685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.467118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.468011 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.468915 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.469966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.608836 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:48.619137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a2678241-aba9-4a6e-902d-5f2bfe157443 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.200475 Aug 24 06:43:48.619921 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 188/366] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:48 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:48.624635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:48.625580 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:48.633964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.634673 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.635294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.636242 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.636945 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.637472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.697121 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:48.706907 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-be4fec5d-03bc-4390-ab6b-75fb4e4379fd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.266626 Aug 24 06:43:48.707516 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 179/367] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:48 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:48.747788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:48.758725 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-22475f93-27f8-48b9-a894-dc93821a57b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1193 microversion: 2.1 time: 0.137550 Aug 24 06:43:48.759496 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 189/368] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:48 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:49.648984 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:49.651036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:49.666981 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:49.667782 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:49.668514 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:49.669403 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:49.669995 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:49.670730 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:49.732940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:49.733582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:49.736614 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=8 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:49.737263 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:49.742803 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:49.743287 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:49.743715 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:49.744615 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:49.745249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:49.745819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:49.853964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:49.864652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-df878f0a-157c-4b76-964c-acdd1603d83f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.222531 Aug 24 06:43:49.864652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 180/369] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:49 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:49.869918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:49.870627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:49.878917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:49.879668 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:49.880271 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:49.881164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:49.881699 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:49.882202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:49.909528 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:49.920427 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6641564e-7976-464c-8c01-7b2f91972499 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.191395 Aug 24 06:43:49.925096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 190/370] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:49 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:49.963002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:49.964958 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-87ef03d7-d595-4cf7-a1b2-b9f3b221dd1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1193 microversion: 2.1 time: 0.099744 Aug 24 06:43:49.965649 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 181/371] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:49 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:50.888478 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:50.889069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:50.896663 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:50.897377 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:50.900680 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:50.901963 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:50.902426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:50.902845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:50.947975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:50.949537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:50.955667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:50.957145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:50.963313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:50.963313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:50.963313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:50.963313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:50.963719 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.095010 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:51.108440 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cbeef32e-9aaf-40cb-a759-87e3a4a9705b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.224236 Aug 24 06:43:51.109768 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 191/372] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:50 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:51.116844 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:51.117850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:51.125974 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.126959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.127700 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.128861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.129610 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.130286 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.221496 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:51.222228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:51.242525 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-039dbbf5-ce55-4cbf-985d-38b2456b065d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1522 microversion: 2.1 time: 0.298833 Aug 24 06:43:51.246358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2f238beb-0215-4d0c-be33-5399729ea4c8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1193 microversion: 2.1 time: 0.135089 Aug 24 06:43:51.249270 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 192/373] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:51 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:51.252877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 182/374] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:50 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:52.144152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:52.144802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:52.152103 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.157335 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.157335 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.157335 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.157335 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.157732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.270452 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:52.271648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:52.285873 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.289284 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.289884 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.290647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.293922 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.294619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.349068 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:52.358917 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-96a23ff0-3248-445b-8297-ad6346088766 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.218621 Aug 24 06:43:52.376954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 193/375] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:52 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:52.385160 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:52.386345 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:52.393729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.394066 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.395700 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.395700 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.399823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.405612 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.470956 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:52.480587 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-769cd79c-1c52-461e-8d7b-c02b79a22c0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1201 microversion: 2.1 time: 0.114932 Aug 24 06:43:52.481211 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 194/376] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:52 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1201 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:52.504468 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:52.513674 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d3c22a7c-edaf-4dfd-a068-182f1305cab9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1502 microversion: 2.1 time: 0.247003 Aug 24 06:43:52.514265 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 183/377] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:52 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1502 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:52.536297 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:52.536904 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:52.555823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.556337 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.556731 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.557491 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.557940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.558358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.815211 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:52.824873 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1af67d5e-cab3-4514-835d-a5235f2787ef tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1515 microversion: 2.1 time: 0.293432 Aug 24 06:43:52.825511 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 195/378] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:52 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:53.394778 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:53.396136 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:53.403104 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.403884 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.404504 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.405423 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.406046 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.406634 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.502540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:53.503091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:53.510487 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.510984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.511426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.512131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.512586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.513011 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.577938 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:53.587115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-adbe1fea-770c-44d7-a29b-969de54386a6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1211 microversion: 2.1 time: 0.088727 Aug 24 06:43:53.591885 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 196/379] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:53 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:53.629970 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:53.645650 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fec9afc5-151e-42db-b9e0-ee07b40e0e22 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.254728 Aug 24 06:43:53.657505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 184/380] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:53 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:53.919070 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-45ae0502-328b-4806-96bf-9d2a3229b8c3 req-7d97fb5d-d7f9-488e-9655-4b831e563692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed98f99-0b60-4284-b252-931aa0e4adcc", "name": "network-vif-plugged", "status": "completed", "tag": "4c9b237a-0d94-4b19-8954-bbc3140f2b84"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:53.929950 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-45ae0502-328b-4806-96bf-9d2a3229b8c3 req-7d97fb5d-d7f9-488e-9655-4b831e563692 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.930444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-45ae0502-328b-4806-96bf-9d2a3229b8c3 req-7d97fb5d-d7f9-488e-9655-4b831e563692 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.930889 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-45ae0502-328b-4806-96bf-9d2a3229b8c3 req-7d97fb5d-d7f9-488e-9655-4b831e563692 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.934866 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:53.942431 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-45ae0502-328b-4806-96bf-9d2a3229b8c3 req-7d97fb5d-d7f9-488e-9655-4b831e563692 service nova] Creating event network-vif-plugged:4c9b237a-0d94-4b19-8954-bbc3140f2b84 for instance 3ed98f99-0b60-4284-b252-931aa0e4adcc on hv-cinder-85427 Aug 24 06:43:53.948456 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-45ae0502-328b-4806-96bf-9d2a3229b8c3 req-7d97fb5d-d7f9-488e-9655-4b831e563692 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033701 Aug 24 06:43:53.949230 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 197/381] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:43:54.610008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:54.611178 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:54.618734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.619319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.619905 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.620666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.621240 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.621738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.669009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:54.669742 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:54.676442 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.676998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.677455 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.678811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.679168 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.679581 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.829300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:54.838114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2a065e84-d360-4a37-b066-cac4e46df9b1 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.174248 Aug 24 06:43:54.856353 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:54.856701 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 198/382] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:54 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:54.864008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d2858e0a-16cf-480a-9af3-98317b5235f0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.252078 Aug 24 06:43:54.864008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 185/383] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:54 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:55.015161 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-685c4b0f-c3bb-4220-9cf5-d6b2669f1c82 req-9c7e1418-8071-4dd4-ab1f-dc1b9b5e0307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4", "tag": "4d0ce8d9-4180-4c13-aa4c-06f7261b493c"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:55.027133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-685c4b0f-c3bb-4220-9cf5-d6b2669f1c82 req-9c7e1418-8071-4dd4-ab1f-dc1b9b5e0307 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:55.027133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-685c4b0f-c3bb-4220-9cf5-d6b2669f1c82 req-9c7e1418-8071-4dd4-ab1f-dc1b9b5e0307 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:55.027133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-685c4b0f-c3bb-4220-9cf5-d6b2669f1c82 req-9c7e1418-8071-4dd4-ab1f-dc1b9b5e0307 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:55.038401 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-685c4b0f-c3bb-4220-9cf5-d6b2669f1c82 req-9c7e1418-8071-4dd4-ab1f-dc1b9b5e0307 service nova] Creating event network-changed:4d0ce8d9-4180-4c13-aa4c-06f7261b493c for instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 on hv-cinder-85427 Aug 24 06:43:55.045302 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-685c4b0f-c3bb-4220-9cf5-d6b2669f1c82 req-9c7e1418-8071-4dd4-ab1f-dc1b9b5e0307 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033941 Aug 24 06:43:55.045904 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 199/384] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:55.862427 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:55.863025 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:55.870022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:55.870510 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:55.871148 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:55.871837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:55.872590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:55.872844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:55.886868 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:55.887575 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:55.894766 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:55.895254 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:55.903424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:55.903424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:55.903424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:55.903424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.049221 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.058931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f66077cc-5260-4e71-b241-55b91fd79638 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.176394 Aug 24 06:43:56.059509 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 200/385] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:55 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:56.070928 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:56.070928 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:56.076336 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.076823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.077215 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.078094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.078537 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.078952 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.105520 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lazy-loading 'flavor' on Instance uuid eb56c577-522f-4ef5-a3e2-d65c466ebdda {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:43:56.252170 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.260806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d0674646-39f2-4cbc-8aa6-72d26c8d723d tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1358 microversion: 2.1 time: 0.401939 Aug 24 06:43:56.264877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 186/386] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:55 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:56.463644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2f759aab-90f8-453c-8acc-39ffab329441 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda/action" status: 200 len: 32 microversion: 2.1 time: 0.402403 Aug 24 06:43:56.464428 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 201/387] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:43:56 2022] POST /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:43:56.474397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:56.475442 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:56.482305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.482721 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.483154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.483845 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.484295 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.484713 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.728525 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.736767 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1bb01857-5f94-4069-a4be-3bce49677df5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.266631 Aug 24 06:43:56.737354 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 187/388] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:56 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:57.081473 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.082247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:57.088688 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.089325 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.089672 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.090365 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.090811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.091220 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.244780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.252509 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-71f3c311-0c60-455c-89b1-dd69c56c04e9 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.175198 Aug 24 06:43:57.253448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 202/389] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:57.282253 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.282862 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:57.290031 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.290521 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.290954 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.291647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.292101 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.292526 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.435498 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.443322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-08066c0b-94cc-483f-a90f-9f8bdbd11057 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1548 microversion: 2.1 time: 0.165060 Aug 24 06:43:57.447111 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 188/390] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:57.466408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.467005 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:57.473267 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.473737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.474165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.474832 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.476039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.476458 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.604839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.612578 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cd34437f-9af8-44bc-8e71-196f289b35cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1548 microversion: 2.1 time: 0.150220 Aug 24 06:43:57.613217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 203/391] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:57.632458 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.637283 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.638045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Searching by: {'deleted': False, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc'} {{(pid=127728) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 06:43:57.645087 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.645596 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.646081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.646796 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.648063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.648556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.740733 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.multi_cell_list [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127728) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 06:43:57.759882 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.760474 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:57.766599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.767101 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.767549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.768278 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.768720 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.769138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.842681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-712124e5-0744-48e0-a672-43b9cfb16486 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213814 Aug 24 06:43:57.843195 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 189/392] 10.222.0.47 () {58 vars in 1125 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:57.854806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.860254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:57.861414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.861888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.862314 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.863008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.863455 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.863872 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.907403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.915973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6d84a993-873f-4415-96c2-70d785471c14 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.159692 Aug 24 06:43:57.916546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 204/393] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:58.008766 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:58.016571 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-517bf820-7d5b-479d-ad40-86b863b820f8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1548 microversion: 2.1 time: 0.166028 Aug 24 06:43:58.017132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 190/394] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:58.273363 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:58.273968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:58.279936 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.280410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.280838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.281553 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.281997 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.282416 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.424537 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:58.433772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-caa3c8f3-908c-4566-a0ff-8dd05c1df499 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.164564 Aug 24 06:43:58.434338 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 205/395] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:58 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:58.936577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:58.937166 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:58.943659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.944446 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.945363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.955618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.955618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.955618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.086248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:59.093914 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-81015245-f77c-4dec-813e-29e1c37aaa0d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.161229 Aug 24 06:43:59.094503 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 191/396] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:58 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:59.464717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:59.465355 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:59.471841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.472344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.472794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.473567 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.474017 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.474440 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.608175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:59.617088 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-25b8f423-2eef-49c9-86ac-7b2eb46b7a75 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.155351 Aug 24 06:43:59.617713 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 206/397] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:59 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:59.941586 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f0746149-73c5-42d1-a242-f838c44e298a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "930e0b4f-0476-4029-8a24-feb274865e0e"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:59.944610 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f0746149-73c5-42d1-a242-f838c44e298a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:59.951140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f0746149-73c5-42d1-a242-f838c44e298a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.951625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f0746149-73c5-42d1-a242-f838c44e298a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.952055 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f0746149-73c5-42d1-a242-f838c44e298a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.960006 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f0746149-73c5-42d1-a242-f838c44e298a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.960006 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f0746149-73c5-42d1-a242-f838c44e298a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.960006 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f0746149-73c5-42d1-a242-f838c44e298a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.116626 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:00.117350 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:00.123271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.123738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.124162 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.124877 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.125363 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.125780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.273110 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:00.282503 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1669d8bd-c582-4546-9041-d7887a6612a3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.170193 Aug 24 06:44:00.283283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 207/398] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:00 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:00.643009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:00.643009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:00.647238 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.648393 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.648830 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.649656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.650100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.650519 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.742177 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f0746149-73c5-42d1-a242-f838c44e298a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "POST /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803106 Aug 24 06:44:00.742996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 192/399] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:43:59 2022] POST /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments => generated 194 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:00.788963 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:00.797271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-88d076fa-7d9a-4f04-9644-9d2845a3fb28 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.160738 Aug 24 06:44:00.797960 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 208/400] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:00 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:01.307187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:01.307802 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:01.314435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.314915 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.315473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.316152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.316686 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.317102 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.452607 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:01.456280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:01.461918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-69b7640e-157a-49f2-8cdb-d27bafb48af4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.159541 Aug 24 06:44:01.462473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 193/401] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:01 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:01.822747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:01.823765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:01.833150 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.834030 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.835372 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.836740 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.837718 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.838408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.984280 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:01.993432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9d321ee7-b86c-492c-8944-33aaaf552b3b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.178459 Aug 24 06:44:01.994001 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 209/402] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:01 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:02.484194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:02.484774 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:02.491956 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.492573 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.493134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:02.493904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.494384 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.494961 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:02.631705 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:02.639532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-07c82821-b66c-4896-be4d-dc6d1f8853e4 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.159356 Aug 24 06:44:02.640093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 194/403] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:02 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:03.013562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:03.014081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:03.020048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.020516 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.020945 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.021643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.022083 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.022502 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.160495 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:03.168619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-dd503877-f4c8-4036-8190-c743a89e0f3f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.158983 Aug 24 06:44:03.169206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 210/404] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:03 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:03.660925 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:03.661576 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:03.668640 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.669122 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.669583 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.670270 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.670719 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.671141 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.782951 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2ebaf3b9-f131-48e5-ae71-0c9ecfe46d58 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:03.783445 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2ebaf3b9-f131-48e5-ae71-0c9ecfe46d58 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:03.790433 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2ebaf3b9-f131-48e5-ae71-0c9ecfe46d58 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.790892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2ebaf3b9-f131-48e5-ae71-0c9ecfe46d58 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.791478 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2ebaf3b9-f131-48e5-ae71-0c9ecfe46d58 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.792196 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2ebaf3b9-f131-48e5-ae71-0c9ecfe46d58 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.793076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2ebaf3b9-f131-48e5-ae71-0c9ecfe46d58 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.793230 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2ebaf3b9-f131-48e5-ae71-0c9ecfe46d58 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.809012 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:03.818263 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d9ab693b-fd07-41bc-a0f9-b10c3aafda9a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.161221 Aug 24 06:44:03.819099 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 195/405] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:03 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:03.821743 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2ebaf3b9-f131-48e5-ae71-0c9ecfe46d58 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/ips" status: 200 len: 150 microversion: 2.1 time: 0.042768 Aug 24 06:44:03.822354 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 211/406] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:44:03 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:03.901377 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1919974867", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:03.960062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] validate_networks() for None {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:44:04.190027 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:04.191026 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:04.196972 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.197492 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.197940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.198933 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.199090 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.199514 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.270209 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:44:04.270637 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:44:04.271925 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:44:04.272499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:44:04.272920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:44:04.283758 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.284652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.285089 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.285860 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.286318 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.286742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.306498 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Getting quotas for project 292886d5ade34571bc39c5707171509d. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:44:04.310820 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Getting quotas for user 9ba76090d89f4b5d842fb245cc95984b and project 292886d5ade34571bc39c5707171509d. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:44:04.322445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:44:04.324803 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:44:04.343986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:04.353724 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-328a6da6-c47c-491d-b45d-70b56c5e9cde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.167442 Aug 24 06:44:04.354391 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 212/407] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:04 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:04.505738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cad63b97-63fc-46e8-8111-130814084ea6 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608013 Aug 24 06:44:04.506442 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 196/408] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:44:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:44:04.522107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-db0b63b9-be4d-4ea7-b2db-23e011d7d5e0 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:04.523107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-db0b63b9-be4d-4ea7-b2db-23e011d7d5e0 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:04.587165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-db0b63b9-be4d-4ea7-b2db-23e011d7d5e0 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:04.590562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-db0b63b9-be4d-4ea7-b2db-23e011d7d5e0 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1215 microversion: 2.1 time: 0.072824 Aug 24 06:44:04.591127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 213/409] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:04 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:04.841805 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:04.842552 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:04.849631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.850126 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.850552 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.851236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.851761 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.852178 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.995474 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:05.003575 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-85d4a956-61e8-4b51-bbff-ed7b94f5ae1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.167652 Aug 24 06:44:05.004124 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 197/410] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:04 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:05.374989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:05.375663 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:05.381611 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:05.386217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:05.386217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:05.386217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:05.386217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:05.386617 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:05.399995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:05.518073 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:05.525809 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3ff2e26c-8a8d-4b2a-aac7-926c7f5095ea tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.154612 Aug 24 06:44:05.526385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 214/411] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:05 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:05.611916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:05.612763 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:05.619987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:05.620703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:05.621412 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:05.622296 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:05.622963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:05.623630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:05.692610 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:05.700690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fdccb13d-d85d-488c-8a5c-531f62477dca tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1219 microversion: 2.1 time: 0.092774 Aug 24 06:44:05.701288 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 198/412] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:05 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:06.026333 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:06.026932 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:06.033591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.034068 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.034497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.035184 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.035628 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.036040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.175446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:06.183641 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a9e5b9c9-aff0-4082-8067-1158c3702532 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.162008 Aug 24 06:44:06.184217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 215/413] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:06 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:06.546464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:06.547103 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:06.553653 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.554140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.554580 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.556081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.556634 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.557066 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.696952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:06.704908 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-da323271-0bfe-4f9e-8ae7-531552aba81d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.162178 Aug 24 06:44:06.705454 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 199/414] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:06 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:06.714329 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-bc5c2355-cf62-4ea1-8f8f-98ad68f96c46 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a23a9b83-7be5-48f9-a910-61c2682cf58e"}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:06.717091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-bc5c2355-cf62-4ea1-8f8f-98ad68f96c46 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:06.722874 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:06.723506 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc5c2355-cf62-4ea1-8f8f-98ad68f96c46 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.723652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:06.723992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc5c2355-cf62-4ea1-8f8f-98ad68f96c46 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.724424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc5c2355-cf62-4ea1-8f8f-98ad68f96c46 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.725124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc5c2355-cf62-4ea1-8f8f-98ad68f96c46 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.725640 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc5c2355-cf62-4ea1-8f8f-98ad68f96c46 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.726030 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bc5c2355-cf62-4ea1-8f8f-98ad68f96c46 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.729969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.730459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.730902 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.731602 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.732061 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.732480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.797811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:06.807431 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6511d516-e44c-44f6-a88c-c2f5463f98ea tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1267 microversion: 2.1 time: 0.089116 Aug 24 06:44:06.808183 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 200/415] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:06 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:07.205770 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:07.207919 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:07.213487 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.213965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.214513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.215203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.215673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.216064 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.349615 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:07.358338 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b265d4a0-84f6-43a4-bfc0-f02f92b45df9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.156593 Aug 24 06:44:07.358929 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 201/416] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:07 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:07.732653 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:07.733307 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:07.739729 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.740210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.740645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.741379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.741843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.742267 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.970695 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:07.979179 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-52165eab-bc47-4d64-9c00-53177bc700b8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.255665 Aug 24 06:44:07.979747 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 202/417] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:07 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:07.984264 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:07.984917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:07.990574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.991131 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.991914 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.992681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.993791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.994221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:08.061803 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:08.070054 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f09e9af8-26ab-4d56-9bbd-c4d4e7963950 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1285 microversion: 2.1 time: 0.089295 Aug 24 06:44:08.071676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 203/418] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:07 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:08.354499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-d235ba56-61e3-40c1-8cf7-724267ecc082 req-b1eabf2f-16b3-4b41-891e-0234ca063c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4", "name": "network-vif-plugged", "status": "completed", "tag": "4d0ce8d9-4180-4c13-aa4c-06f7261b493c"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:08.375242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-d235ba56-61e3-40c1-8cf7-724267ecc082 req-b1eabf2f-16b3-4b41-891e-0234ca063c9d service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:08.375823 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-d235ba56-61e3-40c1-8cf7-724267ecc082 req-b1eabf2f-16b3-4b41-891e-0234ca063c9d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:08.376288 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-d235ba56-61e3-40c1-8cf7-724267ecc082 req-b1eabf2f-16b3-4b41-891e-0234ca063c9d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:08.378158 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-bc5c2355-cf62-4ea1-8f8f-98ad68f96c46 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.667909 Aug 24 06:44:08.379537 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 216/419] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:44:06 2022] POST /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments => generated 194 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:44:08.393908 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:08.394061 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-d235ba56-61e3-40c1-8cf7-724267ecc082 req-b1eabf2f-16b3-4b41-891e-0234ca063c9d service nova] Creating event network-vif-plugged:4d0ce8d9-4180-4c13-aa4c-06f7261b493c for instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 on hv-cinder-85427 Aug 24 06:44:08.396859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:08.401920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-d235ba56-61e3-40c1-8cf7-724267ecc082 req-b1eabf2f-16b3-4b41-891e-0234ca063c9d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051250 Aug 24 06:44:08.405503 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 204/420] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:44:08.416362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:08.419133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:08.421670 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:08.422447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:08.422916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:08.423339 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:08.584207 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:08.592933 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d7719c28-810c-4802-9495-5e63b9dda819 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.211408 Aug 24 06:44:08.604817 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 217/421] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:08 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:09.001201 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:09.001916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:09.008554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.009046 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.009614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.010543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.010988 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.011429 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.094481 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:09.095986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:09.107825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.115118 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.115563 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.116305 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.117693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.117693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.306307 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:09.322341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ec901f89-da31-40d3-b7ec-84b96edc76c2 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.233394 Aug 24 06:44:09.323502 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 218/422] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:09 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:09.345592 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:09.354528 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-109feec2-5c6b-4fa1-b77c-ead580db3b87 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.358183 Aug 24 06:44:09.355154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 205/423] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:08 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:09.454984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:09.461782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:09.464192 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.464723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.465471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.466111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.466613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.467100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.616165 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:09.616882 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:09.628802 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:09.630621 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:09.632700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.635470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.635470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.635470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.636730 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.637015 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.648541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a426e2dd-9d9f-4ee6-8049-0ac6fad54cd3 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1594 microversion: 2.1 time: 0.197381 Aug 24 06:44:09.650475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 219/424] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:09 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1594 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:09.800951 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:09.809431 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e9ee062f-5b96-4376-8a9e-21f657d4fc96 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.197390 Aug 24 06:44:09.822422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 206/425] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:09 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:10.078100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-36e1d4a2-8122-4347-8782-a7b6f142421e req-f63808c9-0f1f-452d-872e-b2881ef67a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea3b017-0e5b-4567-8f3c-d97d70d4b559", "tag": "8a94a4dd-6760-4c37-9f50-89551bf22624"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:10.089806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-36e1d4a2-8122-4347-8782-a7b6f142421e req-f63808c9-0f1f-452d-872e-b2881ef67a7e service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.090543 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-36e1d4a2-8122-4347-8782-a7b6f142421e req-f63808c9-0f1f-452d-872e-b2881ef67a7e service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.090983 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-36e1d4a2-8122-4347-8782-a7b6f142421e req-f63808c9-0f1f-452d-872e-b2881ef67a7e service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.104839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-36e1d4a2-8122-4347-8782-a7b6f142421e req-f63808c9-0f1f-452d-872e-b2881ef67a7e service nova] Creating event network-changed:8a94a4dd-6760-4c37-9f50-89551bf22624 for instance 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 on hv-cinder-85427 Aug 24 06:44:10.109993 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-36e1d4a2-8122-4347-8782-a7b6f142421e req-f63808c9-0f1f-452d-872e-b2881ef67a7e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035752 Aug 24 06:44:10.110853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 220/426] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:10.363247 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:10.364063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:10.378711 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.379375 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.380771 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.382085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.382836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.383367 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.384606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:10.385602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:10.394887 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.395383 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.395820 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.396721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.397170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.397812 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.559904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:10.572761 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6ced3a9d-cada-4913-89dd-6057220b7586 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.213741 Aug 24 06:44:10.573712 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 207/427] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:10 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:10.622204 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:10.632782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c77c5d92-a842-45bf-b9dd-797bd430571e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.256880 Aug 24 06:44:10.633724 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 221/428] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:10 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:10.840188 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:10.840708 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:10.847053 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.847541 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.855078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.855078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.855078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.855078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:11.003480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:11.012029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2f2355fb-7c63-4266-a77a-ebfb005fa464 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.177261 Aug 24 06:44:11.012902 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 208/429] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:10 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:11.594494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:11.595094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:11.602343 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:11.602771 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:11.603195 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:11.603891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:11.604334 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:11.604745 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:11.669392 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:11.671309 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:11.682149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:11.682823 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:11.683408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:11.684289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:11.684945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:11.685898 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:11.839517 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:11.848178 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8f6d613e-339c-40e9-8643-adcf8623b2da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.183961 Aug 24 06:44:11.848914 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 209/430] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:11 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:12.035328 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:12.036046 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:12.043180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:12.043670 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:12.044102 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:12.044817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:12.045398 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:12.057260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:12.060255 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:12.068930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e9626585-f618-4cf2-86e4-d8523dcbac5b tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.478211 Aug 24 06:44:12.070204 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 222/431] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:11 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:12.235109 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:12.249706 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-734717c4-27e9-4930-9b77-dedeed676102 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.218255 Aug 24 06:44:12.259478 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 210/432] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:12 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:12.419142 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-dfc2ee7f-4017-4579-8e12-17210d4d6348 req-cd41fde0-11e0-4180-9149-1c4461e13420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed98f99-0b60-4284-b252-931aa0e4adcc", "tag": "4c9b237a-0d94-4b19-8954-bbc3140f2b84"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:12.430407 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-dfc2ee7f-4017-4579-8e12-17210d4d6348 req-cd41fde0-11e0-4180-9149-1c4461e13420 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:12.431365 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-dfc2ee7f-4017-4579-8e12-17210d4d6348 req-cd41fde0-11e0-4180-9149-1c4461e13420 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:12.432055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-dfc2ee7f-4017-4579-8e12-17210d4d6348 req-cd41fde0-11e0-4180-9149-1c4461e13420 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:12.445552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-dfc2ee7f-4017-4579-8e12-17210d4d6348 req-cd41fde0-11e0-4180-9149-1c4461e13420 service nova] Creating event network-changed:4c9b237a-0d94-4b19-8954-bbc3140f2b84 for instance 3ed98f99-0b60-4284-b252-931aa0e4adcc on hv-cinder-85427 Aug 24 06:44:12.451788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-dfc2ee7f-4017-4579-8e12-17210d4d6348 req-cd41fde0-11e0-4180-9149-1c4461e13420 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036856 Aug 24 06:44:12.452408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 223/433] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:12.875994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:12.876592 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:12.883720 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:12.884200 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:12.884621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:12.885381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:12.885828 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:12.886239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:13.056300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:13.060772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=100 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:13.066163 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6d4baf23-613a-41de-be65-cd4f97cc4a9f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1267 microversion: 2.1 time: 0.193853 Aug 24 06:44:13.066753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 211/434] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:12 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:13.090632 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:13.091347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:13.098561 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:13.099269 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:13.099696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:13.100384 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:13.100827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:13.101268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:13.267229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:13.274296 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:13.274296 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:13.276405 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-54341620-3a41-41eb-a0fd-c72405064d9e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.190176 Aug 24 06:44:13.276999 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 224/435] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:13 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:13.281986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:13.282475 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:13.282965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:13.283666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:13.284110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:13.284560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:13.451517 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:13.460522 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-77ce5d6b-4cd2-4c9b-a56b-f4c0ff09a095 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.192378 Aug 24 06:44:13.462350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 212/436] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:13 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:14.097350 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:14.098700 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:14.106576 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.107255 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.107763 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.108705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.109315 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.109811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.275071 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:14.283473 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-662b7841-62cf-43a1-bbfc-5fbc6a16c973 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1455 microversion: 2.1 time: 0.191421 Aug 24 06:44:14.285166 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 225/437] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:14 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1455 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:14.299232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:14.300114 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:14.307675 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:14.308282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:14.309481 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=4 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:14.313546 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.314113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.314679 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.314878 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.315528 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.315786 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.316255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.316432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.316679 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.317140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.317346 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=6 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:14.317668 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.318288 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.534747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:14.547869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-559b7beb-4435-4639-ae0a-02c52b14824c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1455 microversion: 2.1 time: 0.244879 Aug 24 06:44:14.548897 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 226/438] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:14 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1455 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:14.556936 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:14.557483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:14.564190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.565762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.566400 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.567823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.568529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.569917 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.604033 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:14.654132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:14.676340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8a249a88-12f1-4075-839d-6bfab6ba3bf7 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.381722 Aug 24 06:44:14.677261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 213/439] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:14 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:14.820858 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:14.829492 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b8295df3-37af-4bdd-a0c7-4b09aba3b09e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.279184 Aug 24 06:44:14.830079 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 227/440] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:14 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:15.668654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1198897200"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:15.669269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:15.676302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:15.677036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:15.677511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:15.678221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:15.678722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:15.679109 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:15.703039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:15.704491 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:15.712028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:15.721967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:15.721967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:15.721967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:15.721967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:15.722300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:15.831258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.network.security_group_api [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Adding security group 36352548-bc4d-42d8-8796-8c8d1725de65 to port 4c9b237a-0d94-4b19-8954-bbc3140f2b84 Aug 24 06:44:16.009687 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:16.017677 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-afce8434-9004-4716-b961-f708f2267eb1 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.319045 Aug 24 06:44:16.018268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 228/441] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:15 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:16.023118 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:16.024110 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:16.035497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.036260 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.036770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.038653 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.039825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.041056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.278386 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:16.286696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0076a591-df34-4ae1-9059-6dc137e15eaf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1501 microversion: 2.1 time: 0.266928 Aug 24 06:44:16.287096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 229/442] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:16 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1501 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:16.318557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b13a892-70a7-4844-a4f1-c4ea2e8af3af"}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:16.321128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:16.327599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.328592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.328592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.329121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.329625 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.330039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.357248 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] HTTP exception thrown: Cannot 'attach_volume' instance eb56c577-522f-4ef5-a3e2-d65c466ebdda while it is in vm_state rescued Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Request method failure captured: Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: POST /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda/os-volume_attachments HTTP/1.1 Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 74 Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBchMQjcmjijIBhpNwhXBtxs1VYqlxbDph_btSBqtQJD0W420IcVXlkq_bxPzo9Wo0IAQ0x7-Rc5rZFp87wdxqiPq9b8-SlxrXff7vRJvQ8OS4DfdDyvZmhbpacyJWfoSCxJ4jHaBYaZmu0BXGlG7tEmEDNtFuu-zYjfP3jWErKuEk_I Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:44:16.359052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50896ec327454f28b1987cd4271b6e27", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 026744699ed54dce8dc240e44e8aefb3 Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {"volumeAttachment": {"volumeId": "8b13a892-70a7-4844-a4f1-c4ea2e8af3af"}} Aug 24 06:44:16.361796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Cannot 'attach_volume' instance eb56c577-522f-4ef5-a3e2-d65c466ebdda while it is in vm_state rescued Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'server_id': 'eb56c577-522f-4ef5-a3e2-d65c466ebdda', 'body': {'volumeAttachment': {'volumeId': '8b13a892-70a7-4844-a4f1-c4ea2e8af3af'}}} Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eb56c577-522f-4ef5-a3e2-d65c466ebdda in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:16.363464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance eb56c577-522f-4ef5-a3e2-d65c466ebdda while it is in vm_state rescued Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:16.376881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:16.382656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:16.382656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:16.382656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance eb56c577-522f-4ef5-a3e2-d65c466ebdda while it is in vm_state rescued Aug 24 06:44:16.382656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:44:16.382656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Returning 409 to user: Cannot 'attach_volume' instance eb56c577-522f-4ef5-a3e2-d65c466ebdda while it is in vm_state rescued {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:16.382656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e762991a-8931-4091-b50d-73aa39dcc997 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046085 Aug 24 06:44:16.382656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 230/443] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:44:16 2022] POST /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 06:44:16.384230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6295f913-1b78-4ab6-be93-de33ace2d108 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "POST /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/action" status: 202 len: 0 microversion: 2.1 time: 0.703872 Aug 24 06:44:16.384230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 214/444] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:44:15 2022] POST /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:44:16.384230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-4f8d1f95-faa9-4e16-b488-c7d87655c425 req-a7fac97f-1411-45fa-982c-c33720ff8586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed98f99-0b60-4284-b252-931aa0e4adcc", "tag": "4c9b237a-0d94-4b19-8954-bbc3140f2b84"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:16.385655 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6bfd2e35-ae0e-49a2-aae7-d918c9f93556 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:16.385931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6bfd2e35-ae0e-49a2-aae7-d918c9f93556 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:16.386454 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-4f8d1f95-faa9-4e16-b488-c7d87655c425 req-a7fac97f-1411-45fa-982c-c33720ff8586 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.386942 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-4f8d1f95-faa9-4e16-b488-c7d87655c425 req-a7fac97f-1411-45fa-982c-c33720ff8586 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.387441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-4f8d1f95-faa9-4e16-b488-c7d87655c425 req-a7fac97f-1411-45fa-982c-c33720ff8586 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.402673 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6bfd2e35-ae0e-49a2-aae7-d918c9f93556 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.403168 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6bfd2e35-ae0e-49a2-aae7-d918c9f93556 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.403669 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6bfd2e35-ae0e-49a2-aae7-d918c9f93556 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.403919 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-4f8d1f95-faa9-4e16-b488-c7d87655c425 req-a7fac97f-1411-45fa-982c-c33720ff8586 service nova] Creating event network-changed:4c9b237a-0d94-4b19-8954-bbc3140f2b84 for instance 3ed98f99-0b60-4284-b252-931aa0e4adcc on hv-cinder-85427 Aug 24 06:44:16.404385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6bfd2e35-ae0e-49a2-aae7-d918c9f93556 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.408896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6bfd2e35-ae0e-49a2-aae7-d918c9f93556 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.408896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6bfd2e35-ae0e-49a2-aae7-d918c9f93556 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.411350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-4f8d1f95-faa9-4e16-b488-c7d87655c425 req-a7fac97f-1411-45fa-982c-c33720ff8586 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038760 Aug 24 06:44:16.412710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 215/445] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:16.422182 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:16.423092 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:16.427595 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:16.431266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.433368 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.434082 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.435084 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.435773 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.436414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.668390 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:16.679161 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-132008bb-7b2e-4e98-b2e2-0ad50815f6cb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1760 microversion: 2.1 time: 0.264652 Aug 24 06:44:16.697414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 216/446] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:16 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1760 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:16.816541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6bfd2e35-ae0e-49a2-aae7-d918c9f93556 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda/action" status: 202 len: 0 microversion: 2.1 time: 0.442810 Aug 24 06:44:16.817953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 231/447] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:44:16 2022] POST /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:44:16.827196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:16.827839 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:16.834433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.835236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.835673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.837328 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.838092 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.844260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:17.004841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:17.018222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-32c9e020-9fb9-400c-86b2-fc1ab70f7b2c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1509 microversion: 2.1 time: 0.194898 Aug 24 06:44:17.019480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 217/448] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:16 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:17.041497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:17.042853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:17.050534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:17.051029 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:17.051463 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:17.052175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:17.052629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:17.053045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:17.247235 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:17.255681 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7505c02a-5602-4afc-bf05-2c96e7d79238 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.219144 Aug 24 06:44:17.256268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 232/449] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:17 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:17.317494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-b698cfd9-f427-4f5f-bac3-83dddd823a51 req-8a3d0acf-58c1-4e24-a21c-fdc3f24456b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4", "tag": "4d0ce8d9-4180-4c13-aa4c-06f7261b493c"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:17.328938 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-b698cfd9-f427-4f5f-bac3-83dddd823a51 req-8a3d0acf-58c1-4e24-a21c-fdc3f24456b6 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:17.329467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-b698cfd9-f427-4f5f-bac3-83dddd823a51 req-8a3d0acf-58c1-4e24-a21c-fdc3f24456b6 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:17.329899 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-b698cfd9-f427-4f5f-bac3-83dddd823a51 req-8a3d0acf-58c1-4e24-a21c-fdc3f24456b6 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:17.343880 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-b698cfd9-f427-4f5f-bac3-83dddd823a51 req-8a3d0acf-58c1-4e24-a21c-fdc3f24456b6 service nova] Creating event network-changed:4d0ce8d9-4180-4c13-aa4c-06f7261b493c for instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 on hv-cinder-85427 Aug 24 06:44:17.350428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-b698cfd9-f427-4f5f-bac3-83dddd823a51 req-8a3d0acf-58c1-4e24-a21c-fdc3f24456b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037557 Aug 24 06:44:17.351230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 218/450] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:18.040973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:18.041798 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:18.048702 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:18.049305 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:18.049832 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:18.050538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:18.050999 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:18.051425 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:18.236517 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:18.245455 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-fbaf82b8-eef2-401b-94d0-6a06ec941e4c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1509 microversion: 2.1 time: 0.209241 Aug 24 06:44:18.246023 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 233/451] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:18 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:18.279676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:18.280407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:18.287128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:18.287631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:18.290722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:18.290722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:18.290722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:18.290722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:18.446266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:18.457091 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-90327a75-a04b-4359-9799-4afaa6abd176 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.182216 Aug 24 06:44:18.458445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 219/452] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:18 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:19.191837 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-adb40622-22c2-4def-94b7-005be93d584f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:19.192394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-adb40622-22c2-4def-94b7-005be93d584f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:19.199979 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adb40622-22c2-4def-94b7-005be93d584f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:19.200472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adb40622-22c2-4def-94b7-005be93d584f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:19.200907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adb40622-22c2-4def-94b7-005be93d584f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:19.201655 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adb40622-22c2-4def-94b7-005be93d584f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:19.202097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adb40622-22c2-4def-94b7-005be93d584f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:19.202512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-adb40622-22c2-4def-94b7-005be93d584f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:19.231398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-adb40622-22c2-4def-94b7-005be93d584f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/ips" status: 200 len: 147 microversion: 2.1 time: 0.043413 Aug 24 06:44:19.233382 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 234/453] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:44:19 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/ips => generated 147 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:19.266580 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:19.267544 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:19.274645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:19.275383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:19.275636 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:19.276248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:19.277022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:19.279979 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:19.480607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:19.481334 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:19.487527 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:19.493796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:19.493796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:19.493796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:19.493796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:19.494170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:19.539615 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:19.548067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-881adf7a-f12c-4c42-bbf5-7c958247405c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1509 microversion: 2.1 time: 0.285332 Aug 24 06:44:19.552488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 220/454] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:19 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:19.637308 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:19.645203 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-129a9fe6-7b60-45d8-9af0-4db658724dbf tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.168904 Aug 24 06:44:19.645785 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 235/455] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:19 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:20.571020 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:20.572571 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:20.579369 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:20.580152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:20.580977 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:20.581594 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:20.582057 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:20.582565 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:20.667419 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:20.668203 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:20.674744 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:20.675229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:20.675837 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:20.676696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:20.677433 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:20.682717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:20.834402 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:20.846309 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b2a3a527-ed42-4b37-9b59-6749bfe91e6d tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.181282 Aug 24 06:44:20.857582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 236/456] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:20 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:20.864647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4e62b993-d940-4efc-ad1a-2c43345afc25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:20.865138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4e62b993-d940-4efc-ad1a-2c43345afc25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:20.871762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e62b993-d940-4efc-ad1a-2c43345afc25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:20.872242 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e62b993-d940-4efc-ad1a-2c43345afc25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:20.872678 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e62b993-d940-4efc-ad1a-2c43345afc25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:20.873405 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e62b993-d940-4efc-ad1a-2c43345afc25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:20.873920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e62b993-d940-4efc-ad1a-2c43345afc25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:20.874341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e62b993-d940-4efc-ad1a-2c43345afc25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:20.908305 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4e62b993-d940-4efc-ad1a-2c43345afc25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/ips" status: 200 len: 153 microversion: 2.20 time: 0.049425 Aug 24 06:44:20.909138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 237/457] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Aug 24 06:44:20 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/ips => generated 153 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:44:21.007474 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:21.017654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2307d7ad-ec7f-4f7e-82fb-93b65fd3994d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1509 microversion: 2.1 time: 0.451118 Aug 24 06:44:21.030583 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 221/458] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:20 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1509 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:21.724217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-003e4dd2-7d1d-4294-bb4d-80ef0e612d2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: .version_select at 0x7fb5d6dea280>, body: {"keypair": {"name": "tempest-keypair-265650173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRfooJimFbWSXcgxuioxwtWV/oJ8D/uCnzmWSE2ADuyINtvUxF8hjPDriWKSFVU7Kf4t+gkUr4xVXYwRnRCEjnI3rUo4H8bEN++9PUfFAFreWEdxNAzTRLt1mrcfxOfCg=="}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:21.731749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=98 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:21.751546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-003e4dd2-7d1d-4294-bb4d-80ef0e612d2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for project b91004b0497d487ea8f1f454c03bbca0. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:44:21.755380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-003e4dd2-7d1d-4294-bb4d-80ef0e612d2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for user 02ad6cdc4ffe4917a7bbf6814297f980 and project b91004b0497d487ea8f1f454c03bbca0. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:44:21.871464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:21.872776 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:21.879832 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:21.880321 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:21.880935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:21.881512 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:21.882001 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:21.882413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:21.906550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-003e4dd2-7d1d-4294-bb4d-80ef0e612d2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191666 Aug 24 06:44:21.907777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 238/459] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:44:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:22.043972 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:22.044601 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:22.046474 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:22.051312 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:22.051841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:22.052339 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:22.053071 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:22.053564 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:22.054020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:22.056538 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0adba528-406c-4957-984e-52c1081bea7e tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.189233 Aug 24 06:44:22.057298 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 222/460] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:21 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:22.264957 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:22.278026 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d3d66210-06f2-4459-8fdf-38a6356011e6 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1509 microversion: 2.1 time: 0.238821 Aug 24 06:44:22.280313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 239/461] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:22 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:22.818617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-2eeca28b-975a-4cce-93b7-796a2573ca44 req-854438a8-cbae-4677-8a8d-54905da2711e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea3b017-0e5b-4567-8f3c-d97d70d4b559", "name": "network-vif-plugged", "status": "completed", "tag": "8a94a4dd-6760-4c37-9f50-89551bf22624"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:22.829838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-2eeca28b-975a-4cce-93b7-796a2573ca44 req-854438a8-cbae-4677-8a8d-54905da2711e service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:22.830309 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-2eeca28b-975a-4cce-93b7-796a2573ca44 req-854438a8-cbae-4677-8a8d-54905da2711e service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:22.830729 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-2eeca28b-975a-4cce-93b7-796a2573ca44 req-854438a8-cbae-4677-8a8d-54905da2711e service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:22.849976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-2eeca28b-975a-4cce-93b7-796a2573ca44 req-854438a8-cbae-4677-8a8d-54905da2711e service nova] Creating event network-vif-plugged:8a94a4dd-6760-4c37-9f50-89551bf22624 for instance 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 on hv-cinder-85427 Aug 24 06:44:22.855330 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-2eeca28b-975a-4cce-93b7-796a2573ca44 req-854438a8-cbae-4677-8a8d-54905da2711e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040440 Aug 24 06:44:22.855929 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 223/462] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:23.079867 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:23.080570 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:23.088679 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.089357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.091968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.091968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.091968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.091968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.234324 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:23.242113 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-639fee6b-7c06-4f03-aacc-fc6406649a33 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.166249 Aug 24 06:44:23.243239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 240/463] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:23 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:23.299974 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:23.300566 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:23.308163 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.308639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.309066 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.310053 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.310690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.311199 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.516695 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:23.524585 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-304dd787-6ecc-4a04-896d-84ddc3fc3866 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1509 microversion: 2.1 time: 0.229219 Aug 24 06:44:23.537206 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 224/464] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:23 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:23.873961 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-588c58ec-f296-4ba8-ac23-63f6a2403728 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81256197-dedc-4076-a254-545918d12f39"}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:23.876284 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-588c58ec-f296-4ba8-ac23-63f6a2403728 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:23.882315 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-588c58ec-f296-4ba8-ac23-63f6a2403728 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.882792 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-588c58ec-f296-4ba8-ac23-63f6a2403728 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.883227 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-588c58ec-f296-4ba8-ac23-63f6a2403728 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.884138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-588c58ec-f296-4ba8-ac23-63f6a2403728 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.884590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-588c58ec-f296-4ba8-ac23-63f6a2403728 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.885010 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-588c58ec-f296-4ba8-ac23-63f6a2403728 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:24.264197 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:24.264821 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:24.271896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:24.272864 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:24.273347 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:24.278397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:24.278397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:24.278397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:24.505612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:24.513893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-178b50f2-a0a5-4a83-94a4-fddd49998c29 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.253380 Aug 24 06:44:24.525734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 225/465] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:24 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:24.525734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:24.525734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:24.526565 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:24.527304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:24.527504 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:24.528191 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:24.528648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:24.529067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:24.555210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lazy-loading 'flavor' on Instance uuid fa5949cc-2133-40b8-9112-b5d571c05f9d {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:44:25.555188 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-418ae10b-ff32-416f-a8a7-e35a2dd42b1e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/action" status: 202 len: 0 microversion: 2.20 time: 1.039156 Aug 24 06:44:25.555888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 226/466] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 24 06:44:24 2022] POST /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/action => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:44:25.561755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:25.562531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:25.568718 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.569203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.570447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.570447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.570895 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.571313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.598883 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-588c58ec-f296-4ba8-ac23-63f6a2403728 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.728861 Aug 24 06:44:25.600154 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 241/467] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:44:23 2022] POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/os-volume_attachments => generated 194 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:25.608129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1984441893", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14e1d9b8-7d9c-4824-8559-f6d63d615d5b"}], "security_groups": [{"name": "tempest-securitygroup--648604598"}], "key_name": "tempest-keypair-265650173", "user_data": "}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:25.735452 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:25.736255 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] validate_networks() for [('14e1d9b8-7d9c-4824-8559-f6d63d615d5b', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:44:25.744381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a29560b6-548a-4363-8462-76e3a3fff95f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1509 microversion: 2.1 time: 0.185905 Aug 24 06:44:25.745204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 227/468] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:25 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:25.753372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:25.754562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:25.767592 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.768442 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.771174 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.771174 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.771760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.772348 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.918738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:25.922545 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:25.931223 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e147bee9-d3df-41cb-a1b7-57df4b050bc8 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.181083 Aug 24 06:44:25.931223 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 228/469] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:25 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:25.932992 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:25.933742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:25.940046 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.940622 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.942656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.943612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.944147 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.944649 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.093259 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:26.101700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:26.103946 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:26.105300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a4888793-b344-40d5-b8c8-4aafbf3e6dc4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.176186 Aug 24 06:44:26.105882 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 229/470] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:25 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:26.387048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:44:26.387458 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:44:26.387978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:44:26.388381 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:44:26.388805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:44:26.398125 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.398595 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.400886 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.400886 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.401450 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.401681 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.419148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for project b91004b0497d487ea8f1f454c03bbca0. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:44:26.423247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for user 02ad6cdc4ffe4917a7bbf6814297f980 and project b91004b0497d487ea8f1f454c03bbca0. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:44:26.434955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:44:26.437381 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:44:26.575387 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a0b27064-576b-467c-83a1-7cd503b7facb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.973902 Aug 24 06:44:26.576043 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 242/471] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:44:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:44:26.587078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f5af1ef3-80ba-4b23-8ba3-64f2501aae77 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:26.588675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f5af1ef3-80ba-4b23-8ba3-64f2501aae77 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:26.662964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f5af1ef3-80ba-4b23-8ba3-64f2501aae77 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:26.662964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f5af1ef3-80ba-4b23-8ba3-64f2501aae77 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1241 microversion: 2.1 time: 0.077478 Aug 24 06:44:26.662964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 230/472] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:26 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:26.779771 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:26.780580 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:26.791025 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.791025 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.791025 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.791025 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.792020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.792020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.942044 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:26.949271 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:26.949884 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:26.951190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ec7c7f87-6e13-40cb-aaed-f01b4a41bd0a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1515 microversion: 2.1 time: 0.176744 Aug 24 06:44:26.951942 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 243/473] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:26 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:26.965396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.965396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.965396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.965396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.965776 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.965776 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:27.114018 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:27.126417 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-eca23087-6dda-4d75-ac61-09a6d939c32a tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1315 microversion: 2.1 time: 0.178195 Aug 24 06:44:27.126417 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 231/474] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:26 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:27.129714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:27.130513 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:27.137379 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:27.137938 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:27.138377 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:27.139076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:27.139526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:27.139951 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:27.295541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:27.304508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:27.306479 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:27.310162 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cc927623-4487-4177-a3ec-b65049ca6263 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.184577 Aug 24 06:44:27.311388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 244/475] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:27 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:44:27.692691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:27.693812 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:27.705648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:27.706400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:27.706836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:27.707550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:27.707991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:27.708402 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:27.785669 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:27.795208 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-00054352-3199-42f5-8850-aecc2b4ad311 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1245 microversion: 2.1 time: 0.109546 Aug 24 06:44:27.795975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 232/476] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:27 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:28.143864 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:28.144531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:28.152313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.152788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.153243 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.153951 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.154394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.154807 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.315762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:28.325430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-51776d92-6e15-485b-8c47-ec5dbea6479c tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1464 microversion: 2.1 time: 0.185340 Aug 24 06:44:28.326367 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 245/477] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:28 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1464 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:28.335374 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:28.335982 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:28.343053 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.343708 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.344317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.345141 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.346155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.346680 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.373345 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:28.373838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:28.379746 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.380228 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.380768 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.381582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.382098 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.382521 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.408881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:44:28.480521 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:28.488924 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:28.490457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:28.491625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2eb579b5-3269-4e8a-86a5-11064a66773b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.160293 Aug 24 06:44:28.492164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 233/478] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:28 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:28.519299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:28.703660 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9872de0e-cd8d-4bfd-aa86-ef796b144595 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 204 len: 0 microversion: 2.1 time: 0.334804 Aug 24 06:44:28.704237 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 246/479] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:44:28 2022] DELETE /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:44:28.712469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:28.713063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:28.719792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.720291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.721002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.722976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.722976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.722976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.818802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:28.819506 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:28.826993 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.827614 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.828042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.828724 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.829166 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.829684 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.884843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:28.890651 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-dad8422f-349f-4558-9312-19ecce713c35 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1470 microversion: 2.1 time: 0.182030 Aug 24 06:44:28.891330 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 234/480] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:28 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:28.901663 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:28.910208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-70f464cd-6b2e-4529-b61c-5e6dada4d2b2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1293 microversion: 2.1 time: 0.095718 Aug 24 06:44:28.910781 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 247/481] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:28 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:29.514945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:29.515580 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:29.521597 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.522082 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.522522 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:29.523215 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.523669 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.524094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:29.663371 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:29.673155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:29.674712 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:29.675952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8d00e9ba-ffbb-4552-a070-b38d20d8045f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.164918 Aug 24 06:44:29.676528 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 235/482] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:29 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:29.750186 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-08bafc89-11de-4f37-9f0e-4525889fb2bf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'create', calling method: .version_select at 0x7fb5d472c790>, body: {"keypair": {"name": "tempest-keypair-1723680348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCbOqV0VFsP4HKDvQhfyawn+QlcZP3dGFy7fhwYecFEyItnXGc79mBA2wMbLDVV1d+Vt5tf92zWb8rHUxTTMnCkublOJJxKO8KWs2rcLl0mPH+EGZO66XrSWXnwCsEZKA=="}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:29.767156 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-08bafc89-11de-4f37-9f0e-4525889fb2bf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Getting quotas for project 50896ec327454f28b1987cd4271b6e27. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:44:29.770834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-08bafc89-11de-4f37-9f0e-4525889fb2bf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Getting quotas for user 026744699ed54dce8dc240e44e8aefb3 and project 50896ec327454f28b1987cd4271b6e27. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:44:29.859448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-08bafc89-11de-4f37-9f0e-4525889fb2bf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113190 Aug 24 06:44:29.860041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 248/483] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:44:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:29.912425 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:29.913037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:29.923089 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.923964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.924719 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:29.926035 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.926910 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.927678 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:29.941895 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:29.943438 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:29.953544 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.954348 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.954779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:29.955511 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.955957 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.956368 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:30.030488 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:30.038984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1631d65c-35a5-4e15-bc74-dc947562af74 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1301 microversion: 2.1 time: 0.105068 Aug 24 06:44:30.039672 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 249/484] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:29 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1301 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:30.090827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:30.099487 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d0d8a928-0101-4edc-bb96-c2ceaefeb88f tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1470 microversion: 2.1 time: 0.191205 Aug 24 06:44:30.100090 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 236/485] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:29 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:30.712063 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:30.712722 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:30.721301 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:30.721898 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:30.722426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:30.723244 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:30.724493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:30.724493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:30.878929 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:30.894126 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:30.897210 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:30.898749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c8fc85b9-6202-47c2-9f4f-ba581f09ddec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.201108 Aug 24 06:44:30.919014 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 250/486] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:30 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:31.063930 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:31.064549 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:31.071276 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:31.071965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:31.072415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:31.073144 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:31.074995 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:31.075601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:31.121987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:31.122639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:31.129083 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:31.129523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:31.129956 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:31.130662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:31.131114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:31.131539 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:31.184945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:31.187238 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e46013ca-465f-43a2-9a3e-63d6d0430fec tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1299 microversion: 2.1 time: 0.128788 Aug 24 06:44:31.188044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 237/487] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:31 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:31.297794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:31.307354 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-890756e7-498e-4862-b646-9d23279174df tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1470 microversion: 2.1 time: 0.190394 Aug 24 06:44:31.308433 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 251/488] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:31 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:31.681411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-b13d06ff-3b39-4cc6-acea-5530ab829e4f req-c455aa75-1a2d-44e8-ae0b-fd88d6658d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea3b017-0e5b-4567-8f3c-d97d70d4b559", "name": "network-vif-deleted", "tag": "8a94a4dd-6760-4c37-9f50-89551bf22624"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:31.695335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-b13d06ff-3b39-4cc6-acea-5530ab829e4f req-c455aa75-1a2d-44e8-ae0b-fd88d6658d4a service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:31.695987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-b13d06ff-3b39-4cc6-acea-5530ab829e4f req-c455aa75-1a2d-44e8-ae0b-fd88d6658d4a service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:31.696494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-b13d06ff-3b39-4cc6-acea-5530ab829e4f req-c455aa75-1a2d-44e8-ae0b-fd88d6658d4a service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:31.709254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-b13d06ff-3b39-4cc6-acea-5530ab829e4f req-c455aa75-1a2d-44e8-ae0b-fd88d6658d4a service nova] Creating event network-vif-deleted:8a94a4dd-6760-4c37-9f50-89551bf22624 for instance 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 on hv-cinder-85427 Aug 24 06:44:31.715635 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-b13d06ff-3b39-4cc6-acea-5530ab829e4f req-c455aa75-1a2d-44e8-ae0b-fd88d6658d4a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038212 Aug 24 06:44:31.716577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 238/489] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:31.927969 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:31.928776 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:31.936308 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:31.937483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:31.937483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:31.938244 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:31.938755 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:31.939237 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.082891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:32.092067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:32.093599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:32.094744 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4a3e8015-bbf0-44b6-8026-b7c2bb7bf183 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.172030 Aug 24 06:44:32.095380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 252/490] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:31 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:32.212190 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:32.213125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:32.237742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.237742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.237742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.237742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.238389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.238389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.329768 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:32.330157 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:32.338211 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.338698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.339187 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.340672 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.341144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.341721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.383649 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.384500 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.384925 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.385552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lazy-loading 'fault' on Instance uuid 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:44:32.400870 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:32.411188 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-06755232-20ad-40ea-8821-001b7dc877fe tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.204133 Aug 24 06:44:32.412064 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 239/491] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:32 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:32.443468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:32.452139 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c269ef26-f222-49c3-92ee-f5e23f9750ec tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1305 microversion: 2.1 time: 0.126868 Aug 24 06:44:32.452780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 253/492] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:32 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:33.119959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:33.121320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:33.127826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.129949 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.129949 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.129949 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.129949 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.130525 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.366159 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:33.376331 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:33.376552 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:33.377813 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e59fcb35-a4f6-494a-988b-4cc738b79551 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.261705 Aug 24 06:44:33.378371 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 240/493] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:33 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:33.433714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:33.434319 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:33.440729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.442023 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.442023 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.442457 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.449835 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.449835 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.474937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-762001402", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0592023d-8a9c-41f3-89af-bb66dbebd3a5"}], "security_groups": [{"name": "tempest-securitygroup--1561755744"}], "key_name": "tempest-keypair-1723680348", "user_data": "}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:33.635911 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:33.642481 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] validate_networks() for [('0592023d-8a9c-41f3-89af-bb66dbebd3a5', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:44:33.650293 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-929f28df-0954-4510-8c61-9209782a5de3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.220613 Aug 24 06:44:33.664759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 254/494] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:33 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:33.671180 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:33.671840 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:33.678233 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.679018 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.679444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.680147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.680576 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.680987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.718949 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.719549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.720005 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.720449 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lazy-loading 'fault' on Instance uuid 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:44:33.772041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba76090d89f4b5d842fb245cc95984b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292886d5ade34571bc39c5707171509d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:33.775840 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-758db7e1-2613-4246-b289-57f3654bae85 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 200 len: 1305 microversion: 2.1 time: 0.109880 Aug 24 06:44:33.776419 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 255/495] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:33 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:33.782076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-97d71a83-2464-4b5c-bbf3-0900905459f5 req-e909c9ae-936c-4277-81c0-155db3c1061c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354c7880-d099-464f-b199-c14a91a1c25c", "tag": "b8dc13c2-2b31-47c0-9e39-290fd15256b7"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:33.795204 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-97d71a83-2464-4b5c-bbf3-0900905459f5 req-e909c9ae-936c-4277-81c0-155db3c1061c service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.795681 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-97d71a83-2464-4b5c-bbf3-0900905459f5 req-e909c9ae-936c-4277-81c0-155db3c1061c service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.796142 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-97d71a83-2464-4b5c-bbf3-0900905459f5 req-e909c9ae-936c-4277-81c0-155db3c1061c service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.808480 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-97d71a83-2464-4b5c-bbf3-0900905459f5 req-e909c9ae-936c-4277-81c0-155db3c1061c service nova] Creating event network-changed:b8dc13c2-2b31-47c0-9e39-290fd15256b7 for instance 354c7880-d099-464f-b199-c14a91a1c25c on hv-cinder-85427 Aug 24 06:44:33.813740 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-97d71a83-2464-4b5c-bbf3-0900905459f5 req-e909c9ae-936c-4277-81c0-155db3c1061c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035259 Aug 24 06:44:33.814355 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 256/496] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:34.090589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:44:34.091092 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:44:34.091579 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:44:34.091991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:44:34.092413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:44:34.102413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.102894 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.103356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.104098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.104548 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.105388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.126394 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Getting quotas for project 50896ec327454f28b1987cd4271b6e27. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:44:34.130768 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Getting quotas for user 026744699ed54dce8dc240e44e8aefb3 and project 50896ec327454f28b1987cd4271b6e27. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:44:34.145901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:44:34.148025 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:44:34.266576 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4d148688-cb31-48b5-827e-61ad5a9d0424 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.796230 Aug 24 06:44:34.267821 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 241/497] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:44:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:44:34.281645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-853cea72-c9e0-495e-9f4f-f298d5dbef0f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:34.282467 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-853cea72-c9e0-495e-9f4f-f298d5dbef0f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:34.346689 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-853cea72-c9e0-495e-9f4f-f298d5dbef0f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:34.356603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-853cea72-c9e0-495e-9f4f-f298d5dbef0f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1245 microversion: 2.1 time: 0.081073 Aug 24 06:44:34.357782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 257/498] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:34 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:34.406301 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:34.408083 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:34.416701 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.418392 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.419144 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.419857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.420473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.420986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.627229 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:34.636176 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:34.638214 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:34.639436 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-673a9e5d-f337-400d-b4e9-77613d19b245 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.241861 Aug 24 06:44:34.639991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 242/499] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:34 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:34.672732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:34.673304 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:34.680295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.680774 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.681228 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.681919 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.682458 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.683515 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.798093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:34.798698 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] [instance: 6ea3b017-0e5b-4567-8f3c-d97d70d4b559] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:34.804885 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.805798 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.805798 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.806587 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.806954 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.807372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.822004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] HTTP exception thrown: Instance 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 could not be found. Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Request method failure captured: Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 HTTP/1.1 Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBciwwONtoHva8i9gbKshkuwt3lQQwdudYCcYRuVX97KxS1uCPS5my4kifeLyNo7xC3L5PBbW8uezd6VxrGsyrtdj8s6mdnjd63H3iopnnoONR57KPbKEv8joCbY2t3OwQe5llznSO0hjA2AbRGlRvNDlvFzHwMVXrRq-E858ncrWJSQ Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 292886d5ade34571bc39c5707171509d Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesNegativeTest-1437530912 Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:44:34.824360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/292886d5ade34571bc39c5707171509d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/292886d5ade34571bc39c5707171509d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/292886d5ade34571bc39c5707171509d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_292886d5ade34571bc39c5707171509d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesNegativeTest-1437530912 Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 292886d5ade34571bc39c5707171509d Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesNegativeTest-1437530912 Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesNegativeTest-1437530912-project Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 9ba76090d89f4b5d842fb245cc95984b Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesNegativeTest-1437530912-project Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 could not be found. Aug 24 06:44:34.826471 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '6ea3b017-0e5b-4567-8f3c-d97d70d4b559'} Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 could not be found. Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:34.827827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 could not be found. Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 could not be found. Aug 24 06:44:34.829414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:44:34.830501 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] Returning 404 to user: Instance 6ea3b017-0e5b-4567-8f3c-d97d70d4b559 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:34.830501 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-17f43828-035b-4787-aaf2-e38e7fd82d93 tempest-VolumesNegativeTest-1437530912 tempest-VolumesNegativeTest-1437530912-project] 10.222.0.47 "GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559" status: 404 len: 111 microversion: 2.1 time: 0.031908 Aug 24 06:44:34.830721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:34.830838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 243/500] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:34 2022] GET /compute/v2.1/servers/6ea3b017-0e5b-4567-8f3c-d97d70d4b559 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:44:34.846556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3f328e85-fdf4-44fb-b73b-7fc1f336bad8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.178197 Aug 24 06:44:34.847571 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 258/501] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:34 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:35.329985 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a26a678c-8632-4467-bf39-f7b806d7a159 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:35.336472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a26a678c-8632-4467-bf39-f7b806d7a159 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.336959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a26a678c-8632-4467-bf39-f7b806d7a159 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.337434 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a26a678c-8632-4467-bf39-f7b806d7a159 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.384109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:35.387946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:35.394897 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.395413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.395910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.396612 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.397064 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.397510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.411340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a26a678c-8632-4467-bf39-f7b806d7a159 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Going to try to stop instance {{(pid=127728) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 06:44:35.461268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:35.468891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6ccdad16-24b8-41e1-a43e-848a11223e4a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1249 microversion: 2.1 time: 0.088953 Aug 24 06:44:35.469492 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 259/502] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:35 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:35.662710 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:35.663705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:35.670716 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.671198 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.672994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.672994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.672994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.673781 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.703162 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a26a678c-8632-4467-bf39-f7b806d7a159 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/action" status: 202 len: 0 microversion: 2.1 time: 0.376826 Aug 24 06:44:35.703767 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 244/503] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:44:35 2022] POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:44:35.716808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:35.717712 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:35.724608 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.725416 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.725881 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.726577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.727191 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.727773 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.813042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:35.821662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:35.840140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:35.840140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f2b81f3f-56a2-45b4-9b09-7c0a396bc66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.165543 Aug 24 06:44:35.840140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 260/504] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:35 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:44:35.867601 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:35.871023 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:35.871171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:35.876488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ef21a1ff-5160-4ccd-b40e-f9e7d223575c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.167256 Aug 24 06:44:35.876644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.877053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.877223 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 245/505] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:35 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:35.877796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.879247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.880425 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.880845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.015718 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:36.023568 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9e29ef39-f1a9-49d0-a913-a824c7bdcdc6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.159784 Aug 24 06:44:36.024539 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 261/506] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:35 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:36.489999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:36.490674 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:36.497869 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.498854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.499009 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.499687 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.500134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.500548 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.574228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:36.583185 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-88b96aaa-db7c-40d7-9229-372098137933 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1249 microversion: 2.1 time: 0.096836 Aug 24 06:44:36.583767 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 246/507] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:36 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:36.847880 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:36.848477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:36.850498 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:36.855373 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.860163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.860163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.860163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.860163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.860512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.897666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:36.898369 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:36.900449 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:36.908129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.908787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.909324 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.910101 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.910644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.911139 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.932586 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:37.001384 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:37.010834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:37.012383 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:37.013856 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-957a643b-71a2-4ab5-8183-1929579abdec tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.170237 Aug 24 06:44:37.014447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 262/508] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:36 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:37.048042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:37.049779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:37.057578 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:37.058185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:37.058718 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:37.060184 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:37.061008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:37.061581 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:37.066574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:37.076217 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-df3ab553-a9d0-4ec6-b1ea-fecf1939a961 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.181689 Aug 24 06:44:37.077000 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 247/509] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:36 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:37.220245 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:37.229114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d197fd41-3534-417c-85af-292b966aaa8f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.185895 Aug 24 06:44:37.229566 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 263/510] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:37 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:37.604211 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:37.604856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:37.613479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:37.613927 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:37.614369 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:37.615065 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:37.615515 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:37.615931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:37.756709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:37.773951 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bbc81179-83f0-4b8a-9edd-d2c294a08bbf tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1249 microversion: 2.1 time: 0.173523 Aug 24 06:44:37.786628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 248/511] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:37 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1249 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:38.037696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:38.038345 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:38.042140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:38.048051 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.049361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.050340 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.052148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.052838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.053546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.100656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:38.101639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:38.119641 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.122867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.125499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.130073 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.130073 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.130073 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.249526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:38.258121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:38.259942 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:38.260981 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f0b67b58-e0a7-49b6-a8d8-0ef3552d26d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.227278 Aug 24 06:44:38.261567 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 264/512] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:38 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:44:38.266321 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:38.267158 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:38.273674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.274423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.274854 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.275549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.276166 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.276589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.280008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:38.301685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:38.310900 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a402098a-1c17-4a49-b051-9592ddc7a093 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.213872 Aug 24 06:44:38.311617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 249/513] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:38 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:38.443281 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:38.457303 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b4477da5-8b71-4e91-a0c2-8a03abe0664a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.194393 Aug 24 06:44:38.458340 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 265/514] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:38 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:38.799624 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:38.800273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:38.807863 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.810488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.810488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.811497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.812673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.813456 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.943577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:38.956174 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-38d90bcf-aeca-4d41-a1ca-eb8d2999454f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1305 microversion: 2.1 time: 0.160443 Aug 24 06:44:38.957235 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 250/515] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:38 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1305 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:39.292183 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:39.292914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:39.305579 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.306093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.306657 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.307662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.308139 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.308568 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.335837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:39.337173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:39.349619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.349619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.349619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.349619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.350085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.350085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.545282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:39.555865 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:39.557377 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:39.559393 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-54281f2a-dc34-4b98-a7cc-dcdc832256d0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.271525 Aug 24 06:44:39.559393 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 266/516] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:39 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:44:39.564351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:39.564943 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:39.571443 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.572216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.572851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.573821 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.574502 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.574913 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.676643 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:39.687594 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8b63b017-e114-4ee2-b4ba-9317ef7a592c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.356663 Aug 24 06:44:39.689545 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 251/517] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:39 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:39.749722 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:39.758145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-07ada842-83fd-40b0-90b6-d04b2dd3b2c2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.197353 Aug 24 06:44:39.758717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 267/518] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:39 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:39.982024 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:39.983798 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:39.989735 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.990427 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.990861 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.991560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.992010 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.992509 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.231288 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:40.242857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-236d1e3c-7064-4594-9f60-faeb082bdaee tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.265281 Aug 24 06:44:40.243946 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 252/519] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:39 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:40.582358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:40.583281 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:40.589944 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.590456 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.590886 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.591635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.592073 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.592451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.718843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:40.719949 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:40.738059 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.739025 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.739641 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.740356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.740905 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.741360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.779181 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:40.788814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:40.791145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:40.793810 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ae7f4341-f426-497d-8577-e35df171d6ac tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.215436 Aug 24 06:44:40.795363 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 268/520] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:40 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:40.800309 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:40.801255 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:40.809044 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.810522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.811177 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.812080 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.812733 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.813147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.001413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:41.008922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8f53c109-5541-4c82-aa61-70f6bff96ea0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.212380 Aug 24 06:44:41.009619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 269/521] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:40 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:41.027842 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-d95c7e1d-d8e0-4a1a-8681-3732ef67d15d req-95da64b2-f1d6-4e90-8664-6600d9ed2ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354c7880-d099-464f-b199-c14a91a1c25c", "name": "network-vif-plugged", "status": "completed", "tag": "b8dc13c2-2b31-47c0-9e39-290fd15256b7"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:41.038696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-d95c7e1d-d8e0-4a1a-8681-3732ef67d15d req-95da64b2-f1d6-4e90-8664-6600d9ed2ddc service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.039400 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-d95c7e1d-d8e0-4a1a-8681-3732ef67d15d req-95da64b2-f1d6-4e90-8664-6600d9ed2ddc service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.039989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-d95c7e1d-d8e0-4a1a-8681-3732ef67d15d req-95da64b2-f1d6-4e90-8664-6600d9ed2ddc service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.040237 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:41.050036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-459f019b-b86c-47bf-8aab-6e9f72201a13 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.338016 Aug 24 06:44:41.050614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 253/522] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:40 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:41.056922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-d95c7e1d-d8e0-4a1a-8681-3732ef67d15d req-95da64b2-f1d6-4e90-8664-6600d9ed2ddc service nova] Creating event network-vif-plugged:b8dc13c2-2b31-47c0-9e39-290fd15256b7 for instance 354c7880-d099-464f-b199-c14a91a1c25c on hv-cinder-85427 Aug 24 06:44:41.066414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-d95c7e1d-d8e0-4a1a-8681-3732ef67d15d req-95da64b2-f1d6-4e90-8664-6600d9ed2ddc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043590 Aug 24 06:44:41.067398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 270/523] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:41.237917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-e8db313c-3186-4e45-b902-45573567ad78 req-de16d39b-d69f-45dd-a9d2-2d4bfa94e1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee546bf2-d24c-41cb-925a-b8c8ddd29697", "tag": "ffe40726-5b2e-4cbd-808c-978fb12b7e66"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:41.250979 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-e8db313c-3186-4e45-b902-45573567ad78 req-de16d39b-d69f-45dd-a9d2-2d4bfa94e1b0 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.251704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-e8db313c-3186-4e45-b902-45573567ad78 req-de16d39b-d69f-45dd-a9d2-2d4bfa94e1b0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.252651 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-e8db313c-3186-4e45-b902-45573567ad78 req-de16d39b-d69f-45dd-a9d2-2d4bfa94e1b0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.269854 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:41.271580 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-e8db313c-3186-4e45-b902-45573567ad78 req-de16d39b-d69f-45dd-a9d2-2d4bfa94e1b0 service nova] Creating event network-changed:ffe40726-5b2e-4cbd-808c-978fb12b7e66 for instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 on hv-cinder-85427 Aug 24 06:44:41.271733 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:41.279210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-e8db313c-3186-4e45-b902-45573567ad78 req-de16d39b-d69f-45dd-a9d2-2d4bfa94e1b0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044068 Aug 24 06:44:41.281280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 254/524] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:44:41.285196 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.285990 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.286692 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.287679 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.288331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.288968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.464347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:41.473171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d7dc63ba-e22e-4767-8c60-470f15102d54 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.211737 Aug 24 06:44:41.473993 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 271/525] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:41 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:41.820756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:41.821450 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:41.828634 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.829143 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.834156 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.834156 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.834156 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.834156 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:42.018962 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:42.030071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:42.031693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:42.032504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:42.034859 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:42.034859 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f16d9580-4e0e-4618-8189-a80f00d149b0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.217611 Aug 24 06:44:42.035282 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 255/526] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:41 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:44:42.039339 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:42.039889 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:42.040383 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:42.041136 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:42.041802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:42.042331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:42.075249 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:42.076466 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:42.083619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:42.085704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:42.085704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:42.085704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:42.086074 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:42.086289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:42.215021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:42.223295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2d518158-39cc-4902-bf05-b23a063f98a9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.195596 Aug 24 06:44:42.223986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 272/527] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:42 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:42.342205 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:42.350805 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-605e178f-a789-4f6d-962a-368a01afa3f5 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.281192 Aug 24 06:44:42.351376 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 256/528] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:42 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:42.499621 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:42.499621 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:42.502629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:42.503144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:42.503604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:42.504291 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:42.504733 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:42.505294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:42.648135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:42.656550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-25475409-0604-405a-8231-1b4ea1dc9649 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.165673 Aug 24 06:44:42.657121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 273/529] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:42 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:43.058337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:43.058964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:43.066057 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.066612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.067043 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.067720 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.068164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.068577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.206714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:43.216269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:43.217830 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:43.218996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-840f03b2-5371-44d4-89e2-a6be3f8994df tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.164781 Aug 24 06:44:43.219546 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 257/530] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:43 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:43.243922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:43.244523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:43.251831 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.252316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.252750 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.253476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.253931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.254356 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.372716 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:43.373696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:43.380502 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.381039 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.381883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.382695 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.383274 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.383781 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.389608 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:43.397796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cf9ccc82-7c9a-4a9b-a396-3e2c06d2a5d2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1366 microversion: 2.1 time: 0.157732 Aug 24 06:44:43.398455 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 274/531] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:43 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:43.530828 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:43.539190 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6fad0930-bbc1-462a-87aa-dd2bf443412e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.171150 Aug 24 06:44:43.539752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 258/532] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:43 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:43.678086 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:43.678677 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:43.685330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.686319 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.686618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.687044 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.687507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.687912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.828139 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:43.836323 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1a696d3e-affc-4f61-8ea0-6165870b2fae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.162024 Aug 24 06:44:43.859998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 275/533] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:43 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:44.244201 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:44.244941 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:44.247364 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:44.254877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=8 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:44.254877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.254877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.254877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.255710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.256033 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.256458 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.406995 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:44.415286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:44.416832 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:44.418381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2ab359b7-56dc-45fe-8d7b-691e76eadbdc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.177992 Aug 24 06:44:44.418666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 259/534] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:44 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:44:44.423607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:44.424079 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:44.426574 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=16 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:44.431633 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.432146 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.432580 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.433390 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.433850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.434271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.562109 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:44.562722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:44.569280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.569762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:44.569917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.570189 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.570890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.571338 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.571760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.578620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8b288ad2-ede0-48a8-8f07-bb1b2d76afd1 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1556 microversion: 2.1 time: 0.159387 Aug 24 06:44:44.579505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 276/535] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:44 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:44.603517 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9924f12f-f23c-45b4-b94c-eaea43efd7a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:44.604005 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9924f12f-f23c-45b4-b94c-eaea43efd7a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:44.610587 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924f12f-f23c-45b4-b94c-eaea43efd7a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.611068 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924f12f-f23c-45b4-b94c-eaea43efd7a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.611565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924f12f-f23c-45b4-b94c-eaea43efd7a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.612279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924f12f-f23c-45b4-b94c-eaea43efd7a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.612704 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924f12f-f23c-45b4-b94c-eaea43efd7a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.613151 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924f12f-f23c-45b4-b94c-eaea43efd7a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.711858 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9924f12f-f23c-45b4-b94c-eaea43efd7a3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112065 Aug 24 06:44:44.712903 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 277/536] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 24 06:44:44 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:44:44.721362 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:44.730482 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ecc56e9f-fe8c-4ce1-8f29-5e09a30658c8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.173649 Aug 24 06:44:44.731068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 260/537] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:44 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:44.861254 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:44.862606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:44.869887 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.870384 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.870821 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.871528 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.872850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.873881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:45.018232 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:45.026238 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e0007fca-705f-4cd9-a56b-d9fc268285cc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.171080 Aug 24 06:44:45.026833 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 278/538] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:44 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:45.442367 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:45.442980 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:45.449614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:45.450293 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:45.451474 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:45.452185 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:45.452640 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:45.453063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:45.753436 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:45.754445 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:45.759315 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:45.763844 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:45.764704 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:45.764943 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:45.765680 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:45.766132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:45.766554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:45.770882 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:45.772480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:45.773934 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-dfcfcba3-c160-4289-b3f5-7279bd017fb4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.335575 Aug 24 06:44:45.774685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 261/539] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:45 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:44:45.908989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:45.917145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b67e0018-8c5e-4bae-8145-229da87dd033 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.169856 Aug 24 06:44:45.917737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 279/540] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:45 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:46.046746 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:46.047358 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:46.056780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.057430 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.057996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.058800 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.059373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.060886 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.061590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-5153f7ba-e003-4e75-a70b-99182efd9777 req-142a9348-09aa-40e0-9d8f-12bf75957a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354c7880-d099-464f-b199-c14a91a1c25c", "tag": "b8dc13c2-2b31-47c0-9e39-290fd15256b7"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:46.071218 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-5153f7ba-e003-4e75-a70b-99182efd9777 req-142a9348-09aa-40e0-9d8f-12bf75957a6a service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.071689 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-5153f7ba-e003-4e75-a70b-99182efd9777 req-142a9348-09aa-40e0-9d8f-12bf75957a6a service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.072105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-5153f7ba-e003-4e75-a70b-99182efd9777 req-142a9348-09aa-40e0-9d8f-12bf75957a6a service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.084689 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-5153f7ba-e003-4e75-a70b-99182efd9777 req-142a9348-09aa-40e0-9d8f-12bf75957a6a service nova] Creating event network-changed:b8dc13c2-2b31-47c0-9e39-290fd15256b7 for instance 354c7880-d099-464f-b199-c14a91a1c25c on hv-cinder-85427 Aug 24 06:44:46.089966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-5153f7ba-e003-4e75-a70b-99182efd9777 req-142a9348-09aa-40e0-9d8f-12bf75957a6a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032566 Aug 24 06:44:46.090904 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 280/541] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:44:46.209945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:46.217711 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-13b81111-b895-4802-9665-eadf869107b7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.174742 Aug 24 06:44:46.218286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 262/542] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:46 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:46.799912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:46.800538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:46.806795 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.807282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.811654 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.811654 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.811654 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.811654 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.941103 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:46.942047 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:46.948954 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.949589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.950022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.951006 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.951745 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.952168 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.981510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:46.991563 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:46.993232 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:46.994533 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-01566e25-6331-4657-8083-071daa489939 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.200359 Aug 24 06:44:46.995172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 281/543] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:46 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:47.101395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:47.112523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b77a57d9-1f32-4b56-b132-d8feaececfc1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.177961 Aug 24 06:44:47.113280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 263/544] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:46 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:47.239434 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:47.240716 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:47.256727 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:47.257570 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:47.258295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:47.259440 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:47.260602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:47.261323 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:47.469754 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:47.479684 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6b1ffbc2-daf7-4438-8024-c9e44f24d868 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.243901 Aug 24 06:44:47.480598 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 282/545] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:47 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:48.020118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:48.020731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:48.027097 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.027589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.028025 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.029536 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.032107 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.032107 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.134670 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:48.135908 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:48.143709 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.144201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.144637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.145368 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.145831 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.146244 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.163012 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:48.172787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:48.176533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=100 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:48.182024 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:48.183530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:48.185082 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6f3a0b67-f7be-45cf-93ea-499e4fa46c25 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.168527 Aug 24 06:44:48.188579 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 264/546] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:48 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:48.280387 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:48.288783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6c9ea5ed-1ebe-43df-acb0-9584b33c12c3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.158838 Aug 24 06:44:48.289380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 283/547] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:48 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:48.504418 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:48.505063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:48.511481 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.511964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.512394 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.514010 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.514871 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.515557 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.650733 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:48.658465 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6a1c66e2-d6df-42b1-909c-88e8c6b185f5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.158220 Aug 24 06:44:48.659070 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 265/548] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:48 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:49.021131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-701db00a-7952-4efc-8b5d-f90c65b28d0a req-c1bce9c4-3592-41a6-8bc0-7877fd98d274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5949cc-2133-40b8-9112-b5d571c05f9d", "name": "network-vif-plugged", "status": "completed", "tag": "e60cb872-95c0-4edd-942a-e19544fba59a"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:49.031009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-701db00a-7952-4efc-8b5d-f90c65b28d0a req-c1bce9c4-3592-41a6-8bc0-7877fd98d274 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.031205 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-701db00a-7952-4efc-8b5d-f90c65b28d0a req-c1bce9c4-3592-41a6-8bc0-7877fd98d274 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.031625 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-701db00a-7952-4efc-8b5d-f90c65b28d0a req-c1bce9c4-3592-41a6-8bc0-7877fd98d274 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.043754 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-701db00a-7952-4efc-8b5d-f90c65b28d0a req-c1bce9c4-3592-41a6-8bc0-7877fd98d274 service nova] Creating event network-vif-plugged:e60cb872-95c0-4edd-942a-e19544fba59a for instance fa5949cc-2133-40b8-9112-b5d571c05f9d on hv-cinder-85427 Aug 24 06:44:49.049953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-701db00a-7952-4efc-8b5d-f90c65b28d0a req-c1bce9c4-3592-41a6-8bc0-7877fd98d274 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032500 Aug 24 06:44:49.050497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 284/549] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:49.207669 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:49.208293 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:49.215009 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.215487 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.216579 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.217359 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.217802 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.218249 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.310761 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:49.311459 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:49.318594 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.319082 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.319506 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.320382 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.321397 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.321397 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.366931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:49.376181 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:49.377975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:49.379042 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-73cd88e9-dcf8-4c94-9745-ec6f76898d75 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.175228 Aug 24 06:44:49.379785 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 266/550] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:49 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:49.469985 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:49.479278 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9b5b432b-b9eb-448b-92ea-54331d6fa007 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.173437 Aug 24 06:44:49.479850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 285/551] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:49 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:49.679726 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:49.680605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:49.688568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.689058 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.689530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.690577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.690799 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.691214 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.852028 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:49.867038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-82621b91-7f04-4969-b555-199fdcf855d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.191247 Aug 24 06:44:49.867620 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 267/552] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:49 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:50.402085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:50.402974 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:50.414072 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.414072 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.414501 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:50.415813 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.415997 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.416439 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:50.506565 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:50.507690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:50.533459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.533459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.533459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:50.533459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.534098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.534098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:50.592320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:50.592320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:50.592629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:50.592629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2c9c8199-5bdb-48ce-9300-5b8231ddfcaa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.170626 Aug 24 06:44:50.592629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 286/553] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:50 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:50.668625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:50.678056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b3049a87-5641-4f33-a246-64e443972e87 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.178838 Aug 24 06:44:50.678671 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 268/554] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:50 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:50.888186 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:50.888825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:50.895163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.895683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.896217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:50.897327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.897851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.898283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.044629 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:51.052559 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-acfe8e39-0230-44a1-81d2-1c3840f723d7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.168329 Aug 24 06:44:51.053099 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 287/555] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:50 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:51.473988 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-e6970c21-8b42-425a-a40a-e6bf7c3c33f9 req-28cf0c2a-e805-482e-9cd3-0283f495fae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee546bf2-d24c-41cb-925a-b8c8ddd29697", "name": "network-vif-plugged", "status": "completed", "tag": "ffe40726-5b2e-4cbd-808c-978fb12b7e66"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:51.483898 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-e6970c21-8b42-425a-a40a-e6bf7c3c33f9 req-28cf0c2a-e805-482e-9cd3-0283f495fae0 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.484385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-e6970c21-8b42-425a-a40a-e6bf7c3c33f9 req-28cf0c2a-e805-482e-9cd3-0283f495fae0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.484813 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-e6970c21-8b42-425a-a40a-e6bf7c3c33f9 req-28cf0c2a-e805-482e-9cd3-0283f495fae0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.495763 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-e6970c21-8b42-425a-a40a-e6bf7c3c33f9 req-28cf0c2a-e805-482e-9cd3-0283f495fae0 service nova] Creating event network-vif-plugged:ffe40726-5b2e-4cbd-808c-978fb12b7e66 for instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 on hv-cinder-85427 Aug 24 06:44:51.501531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-e6970c21-8b42-425a-a40a-e6bf7c3c33f9 req-28cf0c2a-e805-482e-9cd3-0283f495fae0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031537 Aug 24 06:44:51.502126 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 269/556] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:51.603624 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:51.606093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:51.611235 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.611694 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.612164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.612846 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.613323 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.613748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.708542 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:51.709807 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:51.721524 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.722406 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.723434 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.724467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.725232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.726002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.778337 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:51.789743 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:51.791292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:51.792519 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0f2d8e14-50e3-4e72-b28f-a799011dfc9b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.192862 Aug 24 06:44:51.793069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 288/557] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:51 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:51.942745 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:51.952525 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e6f0ecad-f82e-4f2c-bc17-5453e1e592df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1725 microversion: 2.1 time: 0.252553 Aug 24 06:44:51.953113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 270/558] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:51 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:52.076592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:52.085879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:52.085879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.085879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.085879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:52.086279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.086279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.086279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:52.220155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:52.228088 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9fc7a7ab-4639-4c68-b3eb-fdfa79e27c57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.155959 Aug 24 06:44:52.228657 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 289/559] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:52 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:52.817071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:52.817665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:52.824523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.825044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.826945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:52.827704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.828170 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.828594 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:52.965508 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:52.973976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:52.974598 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:52.974935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:52.976443 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:52.977639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-780e02da-5555-4d90-ac67-eb602f9a5a4a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.164801 Aug 24 06:44:52.978189 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 271/560] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:52 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:52.981367 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.982046 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.982363 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:52.983132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.983622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.984053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:53.120377 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:53.129084 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8f11ad7a-e6ee-4230-b6d4-a80d674c17dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1702 microversion: 2.1 time: 0.159223 Aug 24 06:44:53.129675 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 290/561] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:52 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1702 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:53.154312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6520da36-c135-402b-8fa7-26e774e3f587 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:53.160241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6520da36-c135-402b-8fa7-26e774e3f587 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:53.160715 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6520da36-c135-402b-8fa7-26e774e3f587 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:53.161148 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6520da36-c135-402b-8fa7-26e774e3f587 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:53.183328 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6520da36-c135-402b-8fa7-26e774e3f587 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Going to try to start instance {{(pid=127728) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 06:44:53.250610 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:53.251212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:53.257103 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:53.257623 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:53.258049 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:53.258722 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:53.259172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:53.259590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:53.396191 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:53.404048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b3bfe7f0-91d5-4976-8306-5580e936f9a1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.158582 Aug 24 06:44:53.404606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 291/562] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:53 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:53.409806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6520da36-c135-402b-8fa7-26e774e3f587 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/action" status: 202 len: 0 microversion: 2.1 time: 0.259698 Aug 24 06:44:53.410449 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 272/563] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:44:53 2022] POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:44:53.418605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:53.419199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:53.426359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:53.426359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:53.432115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:53.432115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:53.432115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:53.432115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:53.569684 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:53.577951 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-24b0a78a-b726-43d3-9e33-23eba6d0ac3b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1711 microversion: 2.1 time: 0.163313 Aug 24 06:44:53.578504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 292/564] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:53 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1711 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:54.001704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:54.002415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:54.008493 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.008960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.009418 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.010096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.010565 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.010979 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.145717 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:54.153795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:54.155871 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:54.157012 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-778e357e-693b-4447-a2ca-c6d833c4e770 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.160237 Aug 24 06:44:54.157692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 273/565] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:53 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:54.425815 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:54.426357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:54.432670 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.433144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.433606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.434286 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.434729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.435148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.584463 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:54.593091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1850bd82-fb30-41ee-ae9f-8ee392a18a57 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1371 microversion: 2.1 time: 0.171141 Aug 24 06:44:54.596623 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 293/566] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:54 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:54.599515 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:54.600241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:54.606419 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.606917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.607402 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.608179 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.608629 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.609094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.822369 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:54.832593 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-30027007-61a9-45ff-9b71-2c5c07366d84 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1711 microversion: 2.1 time: 0.238043 Aug 24 06:44:54.847512 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 274/567] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:54 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1711 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:55.179299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:55.179879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:55.185981 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.186481 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.186909 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:55.187577 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.188020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.188430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:55.319845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:55.327976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:55.329507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:55.330633 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c3b7a3ed-970a-4e11-8e90-e978a5d7fd9f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1745 microversion: 2.20 time: 0.155225 Aug 24 06:44:55.331188 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 294/568] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:55 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:44:55.615191 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:55.615796 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:55.622775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.623484 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.625089 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:55.625852 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.626312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.626734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:55.756155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:55.763810 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7795c032-cd4e-49e0-918c-e1a302c2b33d tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1565 microversion: 2.1 time: 0.152658 Aug 24 06:44:55.764955 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 275/569] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:55 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:55.784635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7e671e00-d7ff-458c-a920-c354931a98d9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:55.785195 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7e671e00-d7ff-458c-a920-c354931a98d9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:55.791590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e671e00-d7ff-458c-a920-c354931a98d9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.792073 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e671e00-d7ff-458c-a920-c354931a98d9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.792510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e671e00-d7ff-458c-a920-c354931a98d9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:55.793289 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e671e00-d7ff-458c-a920-c354931a98d9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.793748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e671e00-d7ff-458c-a920-c354931a98d9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.794168 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e671e00-d7ff-458c-a920-c354931a98d9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:55.855006 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:55.855526 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:55.861628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.862107 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.862535 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:55.863228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.863676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.864078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:55.872240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7e671e00-d7ff-458c-a920-c354931a98d9 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091399 Aug 24 06:44:55.872820 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 295/570] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 24 06:44:55 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:56.175437 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:56.183740 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-eb7f4127-b302-4b12-b2b1-ceb16ccaddbc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1711 microversion: 2.1 time: 0.332667 Aug 24 06:44:56.184351 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 276/571] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:55 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1711 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:56.354161 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:56.354759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:56.361693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:56.367000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:56.367000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:56.367000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:56.367000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:56.367406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:56.506536 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:56.515838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:56.517389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:56.521309 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-94196695-55a8-4b7b-8031-5222601e613a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.168356 Aug 24 06:44:56.522235 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 296/572] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:56 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:57.207031 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:57.208557 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:57.216921 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.218489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.219192 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.220426 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.221390 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.222236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.412235 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:57.427359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-b11797ef-66b3-4f75-a555-51bcf5d8b170 req-7666dffd-1435-41eb-bb9a-97eb5f0c9342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee546bf2-d24c-41cb-925a-b8c8ddd29697", "tag": "ffe40726-5b2e-4cbd-808c-978fb12b7e66"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:57.441137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-b11797ef-66b3-4f75-a555-51bcf5d8b170 req-7666dffd-1435-41eb-bb9a-97eb5f0c9342 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.441937 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-b11797ef-66b3-4f75-a555-51bcf5d8b170 req-7666dffd-1435-41eb-bb9a-97eb5f0c9342 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.442666 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-b11797ef-66b3-4f75-a555-51bcf5d8b170 req-7666dffd-1435-41eb-bb9a-97eb5f0c9342 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.456285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b8efcfd0-87a6-4e4e-bfb6-76e526d009bd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1715 microversion: 2.1 time: 0.243197 Aug 24 06:44:57.457285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 277/573] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:57 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1715 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:57.462175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-b11797ef-66b3-4f75-a555-51bcf5d8b170 req-7666dffd-1435-41eb-bb9a-97eb5f0c9342 service nova] Creating event network-changed:ffe40726-5b2e-4cbd-808c-978fb12b7e66 for instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 on hv-cinder-85427 Aug 24 06:44:57.468109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-b11797ef-66b3-4f75-a555-51bcf5d8b170 req-7666dffd-1435-41eb-bb9a-97eb5f0c9342 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044568 Aug 24 06:44:57.472202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 297/574] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:44:57.548873 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:57.549963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:57.576043 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.576674 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.577778 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.578500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.578955 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.579376 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.847903 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:57.862964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:57.864699 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:57.870435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5480e99f-c5a2-4e8a-8210-8b13098bfb10 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.328130 Aug 24 06:44:57.885415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 278/575] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:57 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:58.906141 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:58.908313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:58.918589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:58.919847 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:58.921031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:58.922527 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:58.923590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:58.924538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:59.147572 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:59.160281 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:59.162164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:59.163805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-72a46000-117a-4031-b03e-f706bbd0b1a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.265664 Aug 24 06:44:59.164876 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 298/576] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:58 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:00.191700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:00.192569 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:00.200570 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:00.201055 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:00.201529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:00.202417 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:00.202417 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:00.203357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:00.363302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:00.371545 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:00.373407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:00.374986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-eb7c134b-13f0-4bb9-b275-d0c13efd50b5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.187016 Aug 24 06:45:00.375786 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 279/577] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:00 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:01.398669 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:01.399398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:01.407732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:01.408549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:01.409053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:01.409783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:01.410396 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:01.410954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:01.612138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:01.621523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:01.623135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:01.624753 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-498fbb2e-909d-43fe-ad70-64646ad6318c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.230712 Aug 24 06:45:01.641733 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 299/578] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:01 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:02.648557 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:02.649283 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:02.657001 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:02.657782 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:02.658723 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:02.661117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:02.661117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:02.661117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:02.850655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:02.862452 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:02.864518 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:02.865815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e2866609-a104-45a8-8d51-352c33ea445a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.221553 Aug 24 06:45:02.866839 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 280/579] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:02 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:03.891482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:03.892189 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:03.901404 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:03.901994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:03.902349 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:03.903040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:03.903482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:03.903894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:04.073035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:04.083102 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:04.084606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:04.085794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-bfde83ec-a172-42bf-b88c-3be9eba2127d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.199565 Aug 24 06:45:04.086353 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 300/580] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:03 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:05.109217 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:05.110625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:05.120975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:05.121514 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:05.121947 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:05.122661 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:05.123115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:05.123534 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:05.130358 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:05.301354 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:05.318036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:05.320407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:05.321697 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d4704a98-3780-4cdf-8ea3-c51bad0c7c7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.217408 Aug 24 06:45:05.322452 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 281/581] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:05 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:06.347154 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:06.347991 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:06.355299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:06.355777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:06.356204 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:06.357316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:06.357984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:06.358863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:06.516977 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:06.516977 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:06.516977 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:06.517414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:06.517414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-24b8fada-b291-4d4d-b44f-79f9035f4368 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.174185 Aug 24 06:45:06.517414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 301/582] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:06 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:07.543996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:07.545459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:07.553394 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:07.553952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:07.554332 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:07.555037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:07.555493 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:07.555920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:07.719623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:07.728580 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:07.730302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:07.731483 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ede6b61e-b8f9-4cdd-80ee-414f4b3a75cb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.194848 Aug 24 06:45:07.732261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 282/583] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:07 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:08.755896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:08.756500 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:08.763164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:08.763638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:08.764068 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:08.765724 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:08.766285 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:08.766708 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:08.895963 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:08.904121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:08.906053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:08.907204 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c02a31a2-7d8c-4e74-b4cf-fc568280a6a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1740 microversion: 2.20 time: 0.155213 Aug 24 06:45:08.907767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 302/584] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:08 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:09.931869 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:09.932479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:09.934867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=72 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:09.940494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:09.940993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:09.941516 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:09.942334 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:09.942811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:09.943302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:10.143965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:10.152312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:10.153872 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:10.155303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-24e87443-9547-474e-840b-1a675c107fa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1722 microversion: 2.20 time: 0.227773 Aug 24 06:45:10.155632 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 283/585] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:09 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:11.178235 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:11.178833 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:11.181205 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=78 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:11.185779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:11.186251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:11.186676 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:11.187428 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:11.187791 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:11.188206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:11.323923 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:11.333227 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:11.334736 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:11.335894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f69a63b7-47ec-4df7-9eb7-3df8b36da1f7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1722 microversion: 2.20 time: 0.161605 Aug 24 06:45:11.336464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 303/586] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:11 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:12.361318 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:12.361926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:12.368605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:12.369084 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:12.369540 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:12.370231 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:12.370688 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:12.371105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:12.504247 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:12.512464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:12.514034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:12.515193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cb6b29b7-dd73-4b85-83e9-504979707eff tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1722 microversion: 2.20 time: 0.159237 Aug 24 06:45:12.515854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 284/587] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:12 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:13.476601 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-85012c89-0114-4f15-ae6c-f69530a7dba6 req-29143d39-d3d1-4903-b0f2-e4131934d4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5949cc-2133-40b8-9112-b5d571c05f9d", "name": "network-vif-unplugged", "status": "completed", "tag": "e60cb872-95c0-4edd-942a-e19544fba59a"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:13.487169 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-85012c89-0114-4f15-ae6c-f69530a7dba6 req-29143d39-d3d1-4903-b0f2-e4131934d4db service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.487626 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-85012c89-0114-4f15-ae6c-f69530a7dba6 req-29143d39-d3d1-4903-b0f2-e4131934d4db service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.488042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-85012c89-0114-4f15-ae6c-f69530a7dba6 req-29143d39-d3d1-4903-b0f2-e4131934d4db service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:13.499399 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.compute.server_external_events [req-85012c89-0114-4f15-ae6c-f69530a7dba6 req-29143d39-d3d1-4903-b0f2-e4131934d4db service nova] Unable to find a host for instance fa5949cc-2133-40b8-9112-b5d571c05f9d. Dropping event network-vif-unplugged {{(pid=127727) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 06:45:13.501013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-85012c89-0114-4f15-ae6c-f69530a7dba6 req-29143d39-d3d1-4903-b0f2-e4131934d4db service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028464 Aug 24 06:45:13.503165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 304/588] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 06:45:13.537851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:13.538457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:13.544552 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.545034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.545505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:13.546194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.547307 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.547832 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:13.683550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:13.692497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:13.694076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:13.695261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6c5adae2-a376-48aa-86fe-dd32405fcc5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1665 microversion: 2.20 time: 0.161439 Aug 24 06:45:13.695842 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 285/589] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:13 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:13.719004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5916722e-dc47-4ce6-8a21-4abf1bbf4fa8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a272ca82-54e1-4d84-8389-7082ffa9519f"}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:13.721597 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5916722e-dc47-4ce6-8a21-4abf1bbf4fa8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:13.727636 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5916722e-dc47-4ce6-8a21-4abf1bbf4fa8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.728124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5916722e-dc47-4ce6-8a21-4abf1bbf4fa8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.728554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5916722e-dc47-4ce6-8a21-4abf1bbf4fa8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:13.729267 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5916722e-dc47-4ce6-8a21-4abf1bbf4fa8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.729715 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5916722e-dc47-4ce6-8a21-4abf1bbf4fa8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.730135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5916722e-dc47-4ce6-8a21-4abf1bbf4fa8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:14.903869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5916722e-dc47-4ce6-8a21-4abf1bbf4fa8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.189054 Aug 24 06:45:14.904555 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 305/590] 10.222.0.47 () {62 vars in 1364 bytes} [Wed Aug 24 06:45:13 2022] POST /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments => generated 188 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:45:15.034747 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:15.035346 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:15.042479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:15.043015 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:15.043478 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:15.044182 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:15.044651 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:15.045074 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:15.089945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127728) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 06:45:15.404905 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-abe820df-b1a1-47d3-ad97-e5956d1a375c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/action" status: 202 len: 0 microversion: 2.20 time: 0.374096 Aug 24 06:45:15.406299 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 286/591] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 24 06:45:15 2022] POST /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:45:15.415031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:15.415730 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:15.421773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:15.422260 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:15.424929 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:15.424929 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:15.425715 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:15.425715 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:15.562162 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:15.571829 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:15.573355 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:15.575702 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a6ce89cd-a3fc-4eaf-b778-a1774956e7a6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1751 microversion: 2.20 time: 0.163432 Aug 24 06:45:15.575702 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 306/592] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:15 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:16.598490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:16.599099 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:16.605987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:16.606470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:16.606899 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:16.607578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:16.608022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:16.608436 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:16.755111 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:16.764361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:16.765899 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:16.767060 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4eb7a77b-661e-4180-b369-bbba3ce08f81 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1751 microversion: 2.20 time: 0.173243 Aug 24 06:45:16.768525 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 287/593] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:16 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:17.792127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:17.798913 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:17.799774 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:17.800331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:17.800823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:17.801731 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:17.802257 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:17.802748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:17.944354 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:17.958476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:17.959984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:17.961172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-87e6015c-ae03-4f2c-ac0d-6a1c41ea9164 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1753 microversion: 2.20 time: 0.172976 Aug 24 06:45:17.961776 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 307/594] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:17 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:18.985135 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:18.985749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:18.992306 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:18.992782 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:18.993235 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:18.993914 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:18.994356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:18.994777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.129339 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:19.140596 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:19.142421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:19.143628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3b841074-dd73-495b-a4db-678f3a629a5d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.162387 Aug 24 06:45:19.144131 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 288/595] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:18 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:20.166773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:20.167389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:20.173575 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:20.174050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:20.174992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:20.175674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:20.176123 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:20.176582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:20.309901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:20.321349 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:20.323203 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:20.324936 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ba470c98-c56a-4c53-b752-12e20d037d21 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.162023 Aug 24 06:45:20.325905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 308/596] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:20 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:21.352768 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:21.354727 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:21.361338 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:21.362716 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:21.363589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:21.364072 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:21.364626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:21.365114 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:21.518684 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:21.527200 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:21.528696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:21.529878 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2387801c-57a7-4423-bc54-60fdf0a51934 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.184764 Aug 24 06:45:21.530435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 289/597] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:21 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:22.554636 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:22.555976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:22.568989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:22.569519 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:22.569953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:22.570899 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:22.571360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:22.571789 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:22.737116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:22.759685 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:22.761316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:22.762416 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0b269231-ad59-4aa1-a5d6-73ef096718bf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.213287 Aug 24 06:45:22.763272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 309/598] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:22 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:45:23.784880 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:23.785605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:23.793165 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:23.793674 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:23.794113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:23.794807 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:23.795264 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:23.795688 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:23.960607 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:23.969968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:23.971822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:23.973162 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-eec6f7cb-2c23-4594-a3c9-9632e61ff0ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.192139 Aug 24 06:45:23.973866 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 290/599] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:23 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:24.997076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:25.000735 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:25.006101 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:25.017867 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:25.018423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:25.019282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:25.020495 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:25.021509 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:25.167418 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:25.176321 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:25.178027 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:25.179171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cd2b2e2f-adae-4a60-8591-66abc39e5035 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.187026 Aug 24 06:45:25.179966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 310/600] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:24 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:26.203193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:26.203784 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:26.211555 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:26.212033 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:26.212461 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:26.213144 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:26.213626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:26.214053 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:26.363656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:26.372724 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:26.374268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:26.375423 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f5f011af-6f8e-4012-9549-8578f1a9605b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.176173 Aug 24 06:45:26.375978 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 291/601] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:26 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:27.398474 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:27.399102 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:27.405605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:27.406080 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:27.406504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:27.407178 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:27.407648 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:27.408060 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:27.549323 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:27.559096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:27.560618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:27.561834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-48f8abd9-8a0b-4474-8f57-3bdba0a71720 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.167206 Aug 24 06:45:27.562422 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 311/602] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:27 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:28.584697 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:28.585524 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:28.592199 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.592671 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.593093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.593888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.594331 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.601948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.741947 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:28.750866 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:28.752424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:28.753617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e786260d-e6ab-4b0a-ab26-8678bb5b22fb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.172886 Aug 24 06:45:28.754226 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 292/603] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:28 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:29.780037 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:29.780686 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:29.788221 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:29.788716 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:29.789214 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:29.789910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:29.790360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:29.790790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:29.939617 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:29.950070 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:29.951608 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:29.952800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6779ec21-f892-4618-8bb0-e3a34ac29084 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.179785 Aug 24 06:45:29.953430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 312/604] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:29 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:30.977099 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:30.977711 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:30.984152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:30.984632 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:30.985062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:30.985797 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:30.986245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:30.986662 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:31.189783 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:31.202259 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:31.203749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:31.204897 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-68b02d04-c06d-4c74-86d8-85fbed04cc52 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.232616 Aug 24 06:45:31.205479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 293/605] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:30 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:32.228444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:32.229235 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:32.236890 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:32.236890 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:32.237391 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:32.238179 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:32.239323 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:32.239759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:32.457241 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:32.467086 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:32.468770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:32.469857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b65cf764-8ff3-4dec-bc5d-79c414d02a03 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.245569 Aug 24 06:45:32.470445 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 313/606] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:32 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:33.494039 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:33.495044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:33.503762 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:33.505051 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:33.505647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:33.506350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:33.506795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:33.507222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:33.646679 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:33.655413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:33.657038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:33.658321 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0140b385-a5b4-48e6-a52c-6902579a27db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.168483 Aug 24 06:45:33.658887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 294/607] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:33 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:34.681599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:34.682289 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:34.689002 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:34.689520 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:34.689948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:34.691272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:34.691272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:34.692211 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:34.825993 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:34.835414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:34.836924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:34.838124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0bfc0b43-5842-4a23-b990-c547a9f8280c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.160594 Aug 24 06:45:34.838899 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 314/608] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:34 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:35.862701 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:35.863352 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:35.869850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:35.870326 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:35.870758 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:35.871440 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:35.871890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:35.872311 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:36.003469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:36.012656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:36.014187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:36.015341 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1a59393f-5a33-441b-b089-59f41c762294 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.156514 Aug 24 06:45:36.015909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 295/609] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:35 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:37.039385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:37.040116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:37.046366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:37.046842 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:37.047268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:37.047948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:37.048393 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:37.048804 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:37.186930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:37.195920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:37.197467 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:37.198621 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8ca63d4a-240f-4873-a9fe-cff4f3bb9838 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.163701 Aug 24 06:45:37.199176 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 315/610] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:37 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:38.222276 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:38.222905 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:38.230373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:38.230848 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:38.231279 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:38.231966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:38.232417 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:38.232838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:38.235421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:38.374521 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:38.384180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:38.386076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:38.386872 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-43db065f-fdb4-4022-93ac-dddcc742e986 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.168847 Aug 24 06:45:38.387428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 296/611] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:38 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:39.409714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:39.410336 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:39.417399 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:39.417877 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:39.418303 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:39.418989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:39.419435 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:39.419851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:39.422486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:39.588608 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:39.597655 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:39.599157 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:39.600890 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-89a69a02-e235-4440-9e22-625e53da936e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.194515 Aug 24 06:45:39.601483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 316/612] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:39 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:40.627080 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:40.627691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:40.630076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:40.635501 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:40.635991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:40.636427 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:40.637306 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:40.637768 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:40.638202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:40.773955 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:40.783109 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:40.784597 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:40.786117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d1cc3244-e40c-4ae0-b80f-d17cce7f6d5b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.163213 Aug 24 06:45:40.786676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 297/613] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:40 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:41.810222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:41.810884 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:41.813130 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=28 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:41.818173 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:41.820816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:41.820816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:41.820816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:41.821239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:41.821331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:41.965815 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:41.976121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:41.977666 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:41.978926 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e11b96a6-2790-4f56-81de-0d2af2c493a2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.173115 Aug 24 06:45:41.979523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 317/614] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:41 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:43.001951 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:43.002571 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:43.009405 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:43.009880 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:43.010306 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:43.010980 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:43.011424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:43.011835 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:43.144075 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:43.152939 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:43.154478 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:43.155618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-122dc481-f327-4fd9-8de0-42bd3797ed63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.157691 Aug 24 06:45:43.156177 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 298/615] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:42 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:44.183662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:44.184256 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:44.192086 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:44.192567 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:44.193075 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:44.195077 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:44.195541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:44.195962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:44.327327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:44.336381 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:44.337930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:44.339087 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-df396b86-bf6f-4f91-99a0-04aa71ab7ed6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.161668 Aug 24 06:45:44.339640 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 318/616] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:44 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:45.362399 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:45.362992 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:45.369798 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:45.370308 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:45.370763 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:45.371450 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:45.371897 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:45.372317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:45.504153 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:45.513966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:45.515457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:45.516597 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a26f1809-22ab-477f-b095-7eacc96f8117 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.158138 Aug 24 06:45:45.517140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 299/617] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:45 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:46.540473 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:46.541025 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:46.547540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:46.548060 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:46.548490 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:46.549212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:46.549657 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:46.550083 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:46.686936 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:46.696471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:46.698020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:46.699164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cdbd66d3-b33c-4cf4-a5bf-5366203f69a8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.163306 Aug 24 06:45:46.699714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 319/618] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:46 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:47.722683 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:47.723294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:47.730399 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:47.730893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:47.731302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:47.731978 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:47.732453 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:47.732968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:47.869616 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:47.878547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:47.880063 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:47.881273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6d67fe9b-f003-4b5e-b8ad-6c8125f6b87f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.162735 Aug 24 06:45:47.881829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 300/619] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:47 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:48.906220 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:48.906765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:48.914644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.916471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.916969 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.917709 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.918159 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.918604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:49.075212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:49.084168 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:49.086426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:49.087598 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c39ff74b-3631-4b7e-b707-485a6c3b8a27 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.186817 Aug 24 06:45:49.088162 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 320/620] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:48 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:50.113598 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:50.114492 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:50.125023 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:50.125813 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:50.126377 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:50.127352 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:50.127991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:50.128570 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:50.272180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:50.283334 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:50.284815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:50.286069 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-24a9889a-a932-49ad-b3dd-194193dfd5ea tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.179045 Aug 24 06:45:50.286992 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 301/621] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:50 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:51.442628 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:51.443239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:51.449544 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.450038 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.450476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.451175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.451630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.452054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.556233 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:45:51.557634 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Wed Aug 24 06:45:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:45:51.583817 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:51.593373 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:51.594871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:51.596019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-aff30966-b2d2-4609-b4a9-26fde7ee086c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.289943 Aug 24 06:45:51.596837 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 321/622] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:51 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:51.826963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-c6753c9b-e383-4ea7-b011-565c3d1bb8de req-f1670843-73a6-4267-b31e-4e51ecfb10e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5949cc-2133-40b8-9112-b5d571c05f9d", "name": "network-vif-plugged", "status": "completed", "tag": "e60cb872-95c0-4edd-942a-e19544fba59a"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:51.840316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-c6753c9b-e383-4ea7-b011-565c3d1bb8de req-f1670843-73a6-4267-b31e-4e51ecfb10e2 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.840794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-c6753c9b-e383-4ea7-b011-565c3d1bb8de req-f1670843-73a6-4267-b31e-4e51ecfb10e2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.841239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-c6753c9b-e383-4ea7-b011-565c3d1bb8de req-f1670843-73a6-4267-b31e-4e51ecfb10e2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.852017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-c6753c9b-e383-4ea7-b011-565c3d1bb8de req-f1670843-73a6-4267-b31e-4e51ecfb10e2 service nova] Creating event network-vif-plugged:e60cb872-95c0-4edd-942a-e19544fba59a for instance fa5949cc-2133-40b8-9112-b5d571c05f9d on hv-cinder-85427 Aug 24 06:45:51.857166 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-c6753c9b-e383-4ea7-b011-565c3d1bb8de req-f1670843-73a6-4267-b31e-4e51ecfb10e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035503 Aug 24 06:45:51.857797 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 302/623] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:52.621206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:52.622011 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:52.628872 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:52.629393 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:52.629821 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:52.630512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:52.630958 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:52.631376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:52.775773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:52.784568 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:52.786060 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:52.787242 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e240b1e4-00e8-47ec-8bac-6e15d9937fdb tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.171732 Aug 24 06:45:52.788040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 322/624] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:52 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:53.812126 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:53.812814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:53.818947 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:53.819421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:53.819844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:53.820631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:53.821698 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:53.822115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:53.956529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:53.966200 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:53.967584 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:53.968742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bfcf9a16-556c-468d-b0a7-64bab5a5cc00 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.161422 Aug 24 06:45:53.969347 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 303/625] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:53 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:54.991884 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:54.992577 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:54.999350 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:54.999840 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.000489 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.000946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.001451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.001869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.140850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:55.142817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-14aea71f-2d6d-4998-9149-13cbc62a773b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:55.145333 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-14aea71f-2d6d-4998-9149-13cbc62a773b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:55.150951 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:55.157323 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:55.157469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-14aea71f-2d6d-4998-9149-13cbc62a773b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.157469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-14aea71f-2d6d-4998-9149-13cbc62a773b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.157663 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7c73ab2c-6279-48c4-8bbc-f54ae02c691d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.165807 Aug 24 06:45:55.157761 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-14aea71f-2d6d-4998-9149-13cbc62a773b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.157855 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 323/626] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:54 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:55.157948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-14aea71f-2d6d-4998-9149-13cbc62a773b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.157948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-14aea71f-2d6d-4998-9149-13cbc62a773b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.157948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-14aea71f-2d6d-4998-9149-13cbc62a773b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.450638 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-14aea71f-2d6d-4998-9149-13cbc62a773b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "POST /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/action" status: 202 len: 0 microversion: 2.1 time: 0.311486 Aug 24 06:45:55.451485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 304/627] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:45:55 2022] POST /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:45:55.461269 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:55.462550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:55.469119 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.469631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.470054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.470739 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.471179 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.471839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.635209 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:55.644545 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d423941b-8982-42b1-8328-5b60742a5187 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1752 microversion: 2.1 time: 0.188815 Aug 24 06:45:55.645036 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 324/628] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:55 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:56.180818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:56.182523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:56.188741 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:56.189298 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:56.189788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.190487 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:56.190933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:56.191348 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.329664 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:56.339596 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:56.341167 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:56.342524 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3a72e2fb-b115-445c-a358-681ca7ba29da tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1809 microversion: 2.20 time: 0.166960 Aug 24 06:45:56.343008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 305/629] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:56 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:56.666763 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:56.667583 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:56.674074 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:56.674582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:56.675013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.675690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:56.676134 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:56.676547 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.824819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:56.833324 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cf02c211-e86d-4127-a279-369cc2324c60 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.171227 Aug 24 06:45:56.833991 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 325/630] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:56 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:57.367026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:57.367632 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:57.374524 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.375004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.375435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.376125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.376570 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.376987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.506630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:57.515473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:57.516986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:57.518181 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ddc88e27-2b27-4b41-a199-f37d67b285f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1796 microversion: 2.20 time: 0.155100 Aug 24 06:45:57.518738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 306/631] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:57 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1796 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:57.857060 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:57.857747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:57.864220 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.864704 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.865138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.865860 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.866312 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.866766 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:58.019003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:58.028577 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a41b6d95-2f4d-4a0e-bdbf-f942388881fc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.176116 Aug 24 06:45:58.029146 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 326/632] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:57 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:59.050748 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:59.051294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:59.058438 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:59.058921 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:59.059346 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:59.060043 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:59.060476 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:59.060890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:59.210190 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:59.218486 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-12ad267a-8cf3-4dd3-8513-5e7f63070c14 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.171841 Aug 24 06:45:59.219041 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 307/633] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:59 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:00.240756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:00.241449 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:00.248619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:00.249098 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:00.249560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:00.250248 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:00.250690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:00.251101 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:00.405475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:00.414212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e85272fd-7d67-4a09-816f-5c141011b813 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.177345 Aug 24 06:46:00.414869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 327/634] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:00 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:01.437371 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:01.438002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:01.444648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:01.445128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:01.445598 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:01.446278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:01.447303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:01.448118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:01.591263 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:01.599719 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-92b7a31c-cdad-44b1-8c77-11c0273e8a83 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.166375 Aug 24 06:46:01.600328 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 308/635] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:01 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:02.620920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:02.621674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:02.628726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:02.629230 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:02.629667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:02.630354 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:02.630801 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:02.631216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:02.778288 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:02.786110 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-08e6c9ed-22d7-4ae9-9507-17a5cc7e41bf tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.169060 Aug 24 06:46:02.786668 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 328/636] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:02 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:03.807659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:03.808250 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:03.815187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:03.815668 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:03.816103 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:03.816828 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:03.817418 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:03.817767 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:03.964539 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:03.973943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c0d3a605-3a39-4ed8-acca-4be90db97d04 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.170126 Aug 24 06:46:03.974627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 309/637] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:03 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:04.995881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:04.996486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:05.003047 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.003530 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.003963 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.004661 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.005108 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.005551 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.157385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:05.165685 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-812725a7-4fb5-45c3-a437-0f5c9411b8df tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.173625 Aug 24 06:46:05.166505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 329/638] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:04 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:06.253005 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:06.253651 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:06.260114 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:06.260614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:06.261035 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:06.261761 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:06.262215 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:06.262638 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:06.408237 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:06.416584 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-27e808a8-41dd-41dc-9c50-66e44d6fefdd tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.168457 Aug 24 06:46:06.417140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 310/639] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:06 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:07.439025 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:07.439793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:07.445978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.446454 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.446890 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.447574 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.448020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.448497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.594416 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:07.605359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1a71eb49-9c90-46d8-97ab-23ff14a8686c tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1757 microversion: 2.1 time: 0.170894 Aug 24 06:46:07.605933 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 330/640] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:07 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:08.632827 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:08.633454 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:08.639896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:08.640375 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:08.640805 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:08.641517 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:08.642061 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:08.642486 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:08.787068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:08.795494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fa9bccbc-8890-4f72-9d61-5cd29b8e4e23 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1760 microversion: 2.1 time: 0.166525 Aug 24 06:46:08.796059 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 311/641] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:08 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:27.694483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=27 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:27.695219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=89 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:27.798859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:27.799143 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:27.805236 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:27.805742 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:27.806210 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:27.806897 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:27.807348 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:27.807790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:27.939499 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lazy-loading 'services' on Instance uuid 821b76aa-235d-42ca-aec6-6597a19525c0 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:46:28.264695 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-39cf591c-9413-40c8-b9c7-0086814d07a0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "DELETE /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/os-volume_attachments/81256197-dedc-4076-a254-545918d12f39" status: 202 len: 0 microversion: 2.1 time: 0.575634 Aug 24 06:46:28.265306 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 331/642] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:46:27 2022] DELETE /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/os-volume_attachments/81256197-dedc-4076-a254-545918d12f39 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:46:30.448093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d66c644f-1244-46bf-bb9e-7e86b8d8619a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:30.451150 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=29 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:30.454358 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:30.456644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d66c644f-1244-46bf-bb9e-7e86b8d8619a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:30.457139 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d66c644f-1244-46bf-bb9e-7e86b8d8619a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:30.457584 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d66c644f-1244-46bf-bb9e-7e86b8d8619a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:30.487941 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d66c644f-1244-46bf-bb9e-7e86b8d8619a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Going to try to stop instance {{(pid=127728) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 06:46:30.677600 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d66c644f-1244-46bf-bb9e-7e86b8d8619a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/action" status: 202 len: 0 microversion: 2.1 time: 0.235482 Aug 24 06:46:30.678227 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 312/643] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:46:30 2022] POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:46:30.688102 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:30.688795 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:30.695176 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:30.695649 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:30.696076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:30.696767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:30.697232 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:30.697648 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:30.836883 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:30.844604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4f1220f5-a91b-458b-bc0f-d0b9bf5973de tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.161205 Aug 24 06:46:30.845171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 332/644] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:30 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:31.868595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:31.869303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:31.875832 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:31.876251 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:31.876677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:31.877387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:31.877831 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:31.878245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:32.005230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:32.013233 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3ff5c186-3f1f-4c92-8e05-470cd10ec836 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.149993 Aug 24 06:46:32.013800 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 313/645] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:31 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:33.034081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:33.034609 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:33.042009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.042483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.042907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.043759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.044204 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.044613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.172741 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:33.180602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7d7eb30f-2268-4f85-9899-2e9f4f5904d6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.150593 Aug 24 06:46:33.181175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 333/646] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:33 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:34.201603 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:34.202207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:34.208810 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:34.209241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:34.209793 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:34.210840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:34.211302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:34.211724 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:34.343029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:34.351925 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-943320db-b8ae-41cd-94de-f5d9736117d8 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.154071 Aug 24 06:46:34.352504 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 314/647] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:34 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:35.372402 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:35.373001 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:35.379379 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:35.379850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:35.380274 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:35.380946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:35.381413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:35.382351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:35.511466 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:35.519109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9a4dbc03-6810-4728-b5a6-7dc031619464 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.150576 Aug 24 06:46:35.519935 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 334/648] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:35 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:36.541079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:36.541713 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:36.547991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:36.548459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:36.548883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:36.549586 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:36.550028 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:36.550441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:36.702196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:36.711024 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-242fdcaa-7f25-49c7-9065-202bc3915d27 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.173961 Aug 24 06:46:36.711595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 315/649] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:36 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:37.732253 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:37.732921 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:37.739825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:37.740316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:37.740748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:37.742726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:37.743216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:37.743737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:37.889723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:37.898240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f70cb304-8d80-4c55-bc4d-15a73a7006db tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.169412 Aug 24 06:46:37.898949 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 335/650] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:37 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:38.920140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:38.920686 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:38.926906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:38.927377 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:38.927802 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:38.928612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:38.929399 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:38.929694 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:39.060245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:39.069671 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-283d1866-dcab-471e-8bba-87ada3b23140 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.153281 Aug 24 06:46:39.070584 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 316/651] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:38 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:40.090818 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:40.091543 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:40.098232 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:40.098707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:40.099132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:40.099818 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:40.100258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:40.101537 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:40.236351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:40.244982 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f03490f1-d2ca-4e2a-bfa8-dfa60472a05c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.158033 Aug 24 06:46:40.245566 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 336/652] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:40 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:41.266413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:41.266950 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:41.273439 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:41.273911 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:41.274395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:41.275224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:41.275676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:41.276091 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:41.640104 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:41.647709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-51aba3da-745d-4d44-93b1-e5f07d32bbf7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.385230 Aug 24 06:46:41.648259 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 317/653] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:41 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:42.667976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:42.668605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:42.675144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:42.675613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:42.676039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:42.676718 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:42.677158 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:42.677641 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:42.914127 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bbbedd54-9883-4de0-a5d6-ea3a1c84b26b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b93249-085e-43d4-94a6-ad144874cd76"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:42.917030 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bbbedd54-9883-4de0-a5d6-ea3a1c84b26b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:42.924255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbbedd54-9883-4de0-a5d6-ea3a1c84b26b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:42.924744 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbbedd54-9883-4de0-a5d6-ea3a1c84b26b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:42.925175 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbbedd54-9883-4de0-a5d6-ea3a1c84b26b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:42.926078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbbedd54-9883-4de0-a5d6-ea3a1c84b26b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:42.926526 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbbedd54-9883-4de0-a5d6-ea3a1c84b26b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:42.927650 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bbbedd54-9883-4de0-a5d6-ea3a1c84b26b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.049627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:43.058178 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c68ecba3-9f51-464c-b874-e07110d0dfc9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.394142 Aug 24 06:46:43.075798 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 337/654] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:42 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:43.680988 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bbbedd54-9883-4de0-a5d6-ea3a1c84b26b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770916 Aug 24 06:46:43.682268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 318/655] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:46:42 2022] POST /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:46:44.078657 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:44.079167 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:44.085743 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:44.086401 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:44.086828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:44.088220 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:44.088668 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:44.089078 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:44.215965 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:44.224017 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-46bc9ef7-177b-4f66-8698-83cb764f5313 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.149312 Aug 24 06:46:44.224572 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 338/656] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:44 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:45.247846 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:45.248449 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:45.254735 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.255216 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.255648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.256330 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.256839 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.257289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.393158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:45.405530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e87e27f3-57c2-478b-bce1-71524cc0fd77 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1679 microversion: 2.1 time: 0.162737 Aug 24 06:46:45.406141 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 319/657] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:45 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:45.442622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-735b82f1-7c9f-4a4e-a6a6-6a0dd1b9908a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:45.443126 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-735b82f1-7c9f-4a4e-a6a6-6a0dd1b9908a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:45.449201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-735b82f1-7c9f-4a4e-a6a6-6a0dd1b9908a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.449694 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-735b82f1-7c9f-4a4e-a6a6-6a0dd1b9908a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.450129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-735b82f1-7c9f-4a4e-a6a6-6a0dd1b9908a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.450819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-735b82f1-7c9f-4a4e-a6a6-6a0dd1b9908a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.451274 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-735b82f1-7c9f-4a4e-a6a6-6a0dd1b9908a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.451698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-735b82f1-7c9f-4a4e-a6a6-6a0dd1b9908a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.475682 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-735b82f1-7c9f-4a4e-a6a6-6a0dd1b9908a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c/ips" status: 200 len: 150 microversion: 2.1 time: 0.146194 Aug 24 06:46:45.483440 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 339/658] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:46:45 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c/ips => generated 150 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:46:45.488639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a23a9b83-7be5-48f9-a910-61c2682cf58e"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:45.491096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:45.497470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.498008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.498383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.499076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.499529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.499953 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.582062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Invalid volume: volume a23a9b83-7be5-48f9-a910-61c2682cf58e is already attached to instances: b0298df5-f99f-4390-8f6f-3320fdfaff52 Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: POST /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c/os-volume_attachments HTTP/1.1 Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 74 Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:46:45.583789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {"volumeAttachment": {"volumeId": "a23a9b83-7be5-48f9-a910-61c2682cf58e"}} Aug 24 06:46:45.585224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Invalid volume: volume a23a9b83-7be5-48f9-a910-61c2682cf58e is already attached to instances: b0298df5-f99f-4390-8f6f-3320fdfaff52 Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'server_id': '354c7880-d099-464f-b199-c14a91a1c25c', 'body': {'volumeAttachment': {'volumeId': 'a23a9b83-7be5-48f9-a910-61c2682cf58e'}}} Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a23a9b83-7be5-48f9-a910-61c2682cf58e is already attached to instances: b0298df5-f99f-4390-8f6f-3320fdfaff52 Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.586007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a23a9b83-7be5-48f9-a910-61c2682cf58e is already attached to instances: b0298df5-f99f-4390-8f6f-3320fdfaff52 Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:45.587709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:45.589158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:45.589158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:46:45.589158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:46:45.589158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a23a9b83-7be5-48f9-a910-61c2682cf58e is already attached to instances: b0298df5-f99f-4390-8f6f-3320fdfaff52 Aug 24 06:46:45.589158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.589158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 400 to user: Invalid volume: volume a23a9b83-7be5-48f9-a910-61c2682cf58e is already attached to instances: b0298df5-f99f-4390-8f6f-3320fdfaff52 {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:46:45.589158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d0a216cf-f784-4a8a-b925-39a6eae3aa56 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100747 Aug 24 06:46:45.589158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 320/659] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:46:45 2022] POST /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:46:45.595408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:45.595891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:45.602156 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.602625 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.603649 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.604398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.604845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.605283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.629573 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:46:45.901229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a9829fa3-a53f-4a6f-a507-60241363897b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 204 len: 0 microversion: 2.1 time: 0.308588 Aug 24 06:46:45.903220 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 340/660] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:46:45 2022] DELETE /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:46:45.910815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:45.911424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:45.918647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.919129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.919559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.920258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.920847 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.921310 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:46.079415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:46.088431 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-92b753da-8fa6-4151-9834-5e3ad3e69128 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1681 microversion: 2.1 time: 0.181539 Aug 24 06:46:46.089419 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 321/661] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:45 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:46.428669 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:46.429407 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:46.436507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:46.437042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:46.437509 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:46.438208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:46.438662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:46.439085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:46.585975 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:46.596038 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4d2a7b13-70a0-45b1-baad-ba275b6c668b tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1656 microversion: 2.1 time: 0.171607 Aug 24 06:46:46.596860 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 341/662] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:46 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1656 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:46.619539 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-dd2919f6-e1e2-4d0e-a95c-90fa8522709f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:46.626020 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd2919f6-e1e2-4d0e-a95c-90fa8522709f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:46.626502 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd2919f6-e1e2-4d0e-a95c-90fa8522709f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:46.626940 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd2919f6-e1e2-4d0e-a95c-90fa8522709f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:46.652240 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-dd2919f6-e1e2-4d0e-a95c-90fa8522709f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Going to try to start instance {{(pid=127728) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 06:46:46.886510 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-dd2919f6-e1e2-4d0e-a95c-90fa8522709f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/action" status: 202 len: 0 microversion: 2.1 time: 0.272617 Aug 24 06:46:46.887117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 322/663] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:46:46 2022] POST /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:46:46.895505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:46.896196 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:46.902294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:46.902777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:46.903204 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:46.903912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:46.904352 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:46.904770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.035615 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:47.044036 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7f52e0e1-c072-4488-95c0-6d80947b4ab4 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1665 microversion: 2.1 time: 0.152624 Aug 24 06:46:47.044601 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 342/664] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:46 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:47.111166 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:47.111859 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:47.118067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:47.118678 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:47.119479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.121024 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:47.121024 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:47.121694 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.257822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:47.266404 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c07baf5b-7eaf-4d28-b379-a268eb595c32 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1681 microversion: 2.1 time: 0.159531 Aug 24 06:46:47.266971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 323/665] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:47 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:48.065846 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:48.066432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:48.073973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:48.074459 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:48.074894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:48.075596 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:48.076044 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:48.076464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:48.207536 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:48.216304 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8ec14e1f-69c9-4d21-84f5-72371710659a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1665 microversion: 2.1 time: 0.154224 Aug 24 06:46:48.216877 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 343/666] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:48 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:48.287938 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:48.288655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:48.295283 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:48.295978 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:48.296205 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:48.296889 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:48.297385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:48.297815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:48.532730 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:48.540633 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-470cf596-65a1-481a-afb2-1e02fd0abd23 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1681 microversion: 2.1 time: 0.256521 Aug 24 06:46:48.541842 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 324/667] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:48 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1681 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:49.060403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-68d1fdd9-cfed-4241-990f-c8eb13e494ad req-097edd87-d0ee-4d1e-940f-2e16015662e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354c7880-d099-464f-b199-c14a91a1c25c", "name": "network-vif-deleted", "tag": "b8dc13c2-2b31-47c0-9e39-290fd15256b7"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:49.070508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-68d1fdd9-cfed-4241-990f-c8eb13e494ad req-097edd87-d0ee-4d1e-940f-2e16015662e7 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:49.071294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-68d1fdd9-cfed-4241-990f-c8eb13e494ad req-097edd87-d0ee-4d1e-940f-2e16015662e7 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:49.071447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-68d1fdd9-cfed-4241-990f-c8eb13e494ad req-097edd87-d0ee-4d1e-940f-2e16015662e7 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:49.083870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-68d1fdd9-cfed-4241-990f-c8eb13e494ad req-097edd87-d0ee-4d1e-940f-2e16015662e7 service nova] Creating event network-vif-deleted:b8dc13c2-2b31-47c0-9e39-290fd15256b7 for instance 354c7880-d099-464f-b199-c14a91a1c25c on hv-cinder-85427 Aug 24 06:46:49.089397 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-68d1fdd9-cfed-4241-990f-c8eb13e494ad req-097edd87-d0ee-4d1e-940f-2e16015662e7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095670 Aug 24 06:46:49.090020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 344/668] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:49.238293 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:49.238824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:49.246823 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:49.247333 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:49.247813 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:49.248623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:49.249072 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:49.249528 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:49.254647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:49.397026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:49.413916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2a68ed2f-f43e-4fb6-ab8c-10881839bc20 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1669 microversion: 2.1 time: 0.179804 Aug 24 06:46:49.418389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 325/669] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:49 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1669 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:49.563423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:49.564521 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:49.570910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:49.571472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:49.572858 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:49.573946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:49.574469 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:49.574977 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:49.650560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:49.658850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a406ea34-808c-4b4e-9792-c105432cc733 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1326 microversion: 2.1 time: 0.099748 Aug 24 06:46:49.659550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 345/670] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:49 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:50.682467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:50.683578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:50.691293 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:50.691777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:50.692211 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:50.692911 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:50.693407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:50.693860 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:50.726006 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:50.726494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:50.726926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:50.727373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lazy-loading 'fault' on Instance uuid 354c7880-d099-464f-b199-c14a91a1c25c {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:46:50.776482 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:50.784342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-39402678-8cbc-44dc-a467-df39f5cd63e2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 200 len: 1331 microversion: 2.1 time: 0.107254 Aug 24 06:46:50.784926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 326/671] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:50 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:51.807061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:51.807655 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:51.814065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:51.814578 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:51.814972 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:51.815656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:51.816097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:51.816510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:51.820732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:51.830341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c HTTP/1.1 Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:46:51.832048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:46:51.833569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '354c7880-d099-464f-b199-c14a91a1c25c'} Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:46:51.834441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:46:51.835823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:51.837066 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:46:51.837066 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-332ae47d-c571-40b3-9218-c9597d115bdd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 404 len: 111 microversion: 2.1 time: 0.030955 Aug 24 06:46:51.837066 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 346/672] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:51 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:46:51.842671 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9b08503c-2f21-49c6-8c27-6dd1a2b3b3d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '.version_select at 0x7fb5d448a670>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:51.926337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9b08503c-2f21-49c6-8c27-6dd1a2b3b3d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-265650173" status: 202 len: 0 microversion: 2.1 time: 0.087394 Aug 24 06:46:51.926805 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 327/673] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 24 06:46:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-265650173 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:46:52.310159 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:52.312688 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:52.319360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:52.319838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:52.320389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:52.321224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:52.321845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:52.322315 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:52.347764 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lazy-loading 'flavor' on Instance uuid ee546bf2-d24c-41cb-925a-b8c8ddd29697 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:46:52.662384 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b3ddfe14-ebf1-421d-acab-2947105db9ff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/action" status: 200 len: 32 microversion: 2.1 time: 0.356391 Aug 24 06:46:52.663300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 347/674] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:46:52 2022] POST /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:46:52.674511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:52.675127 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:52.682470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:52.682957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:52.683396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:52.684129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:52.684581 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:52.685009 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:52.730686 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:52.731267 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:52.737498 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:52.737982 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:52.738792 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:52.739417 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:52.740052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:52.740634 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:52.833857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lazy-loading 'services' on Instance uuid b0298df5-f99f-4390-8f6f-3320fdfaff52 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:46:52.878777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:52.888896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-05dc9372-f83f-4e16-9ed3-3d1a48b38157 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.218293 Aug 24 06:46:52.889531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 328/675] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:52 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:53.032779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9580e49e-20f4-456d-83af-9eea9161f8f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments/a23a9b83-7be5-48f9-a910-61c2682cf58e" status: 202 len: 0 microversion: 2.1 time: 0.306269 Aug 24 06:46:53.033547 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 348/676] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:46:52 2022] DELETE /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments/a23a9b83-7be5-48f9-a910-61c2682cf58e => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:46:53.043652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2b07a429-367b-44a8-8531-c45fdb2b02a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:53.045817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2b07a429-367b-44a8-8531-c45fdb2b02a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:53.052250 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b07a429-367b-44a8-8531-c45fdb2b02a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:53.052250 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b07a429-367b-44a8-8531-c45fdb2b02a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:53.052655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b07a429-367b-44a8-8531-c45fdb2b02a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:53.053505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b07a429-367b-44a8-8531-c45fdb2b02a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:53.054042 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b07a429-367b-44a8-8531-c45fdb2b02a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:53.054714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b07a429-367b-44a8-8531-c45fdb2b02a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:53.089682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2b07a429-367b-44a8-8531-c45fdb2b02a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051914 Aug 24 06:46:53.090446 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 329/677] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:46:53 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:53.912827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:53.913550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:53.920089 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:53.920604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:53.921049 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:53.921839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:53.922300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:53.922775 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:54.057797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:54.066412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3347605d-fd4d-46f4-aa75-e4473397c4fa tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.158361 Aug 24 06:46:54.068747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 349/678] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:53 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:54.102601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0e229fc6-baa5-4c35-8545-fba1c30001eb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:54.105482 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0e229fc6-baa5-4c35-8545-fba1c30001eb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:54.112514 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e229fc6-baa5-4c35-8545-fba1c30001eb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:54.112985 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e229fc6-baa5-4c35-8545-fba1c30001eb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:54.113440 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e229fc6-baa5-4c35-8545-fba1c30001eb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:54.114129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e229fc6-baa5-4c35-8545-fba1c30001eb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:54.114854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e229fc6-baa5-4c35-8545-fba1c30001eb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:54.115275 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0e229fc6-baa5-4c35-8545-fba1c30001eb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:54.148236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0e229fc6-baa5-4c35-8545-fba1c30001eb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049364 Aug 24 06:46:54.148715 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 330/679] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:46:54 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:55.090249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:55.090791 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:55.097387 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.097861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.098288 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.098964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.099404 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.099973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.160080 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e157a1d8-a24d-4ed6-b081-65cd744323ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:55.162243 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e157a1d8-a24d-4ed6-b081-65cd744323ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:55.168685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e157a1d8-a24d-4ed6-b081-65cd744323ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.169165 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e157a1d8-a24d-4ed6-b081-65cd744323ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.169637 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e157a1d8-a24d-4ed6-b081-65cd744323ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.170324 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e157a1d8-a24d-4ed6-b081-65cd744323ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.170772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e157a1d8-a24d-4ed6-b081-65cd744323ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.171187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e157a1d8-a24d-4ed6-b081-65cd744323ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.208656 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e157a1d8-a24d-4ed6-b081-65cd744323ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052456 Aug 24 06:46:55.209458 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 331/680] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:46:55 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 06:46:55.236181 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:55.245351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-eb0c56f0-aa1b-490a-adbb-549a8f560882 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.159870 Aug 24 06:46:55.245919 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 350/681] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:55 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:55.271646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:55.272132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:55.280096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.280572 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.281004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.281726 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.282172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.282585 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.308169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:46:55.605658 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a8700161-b954-4a56-91b6-3d63472d0723 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 204 len: 0 microversion: 2.1 time: 0.337425 Aug 24 06:46:55.606266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 332/682] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:46:55 2022] DELETE /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:46:55.614781 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:55.615414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:55.622786 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.626262 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.626262 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.626262 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.626262 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.627163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.753584 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:55.761879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-65a70251-29d6-4d23-ae75-ccc14ba4631f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1683 microversion: 2.1 time: 0.151097 Aug 24 06:46:55.762439 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 351/683] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:55 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:56.267036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:56.267725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:56.274195 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.275143 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.275646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.276324 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.276773 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.277205 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.414760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:56.423064 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-01049d8e-f153-4752-9c0d-12274700d199 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.160269 Aug 24 06:46:56.423625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 333/684] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:56 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:56.783700 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:56.784747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:56.794841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.795579 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.796783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.797089 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.797632 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.798283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.953684 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:56.961477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-578bc705-837d-43f4-93e1-db5cd7e9c84a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1683 microversion: 2.1 time: 0.181540 Aug 24 06:46:56.961988 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 352/685] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:56 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:57.444910 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:57.445483 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:57.454226 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:57.454789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:57.455150 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:57.455889 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:57.456345 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:57.456769 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:57.505569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-a6c04ba7-3d3c-44ab-b46d-5db07c4a6d03 req-2803c74f-fb7d-437b-857d-1cb79be8cab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0298df5-f99f-4390-8f6f-3320fdfaff52", "name": "network-vif-deleted", "tag": "096dd53a-4e6c-4db9-8564-fd9f67a455e7"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:57.517962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a6c04ba7-3d3c-44ab-b46d-5db07c4a6d03 req-2803c74f-fb7d-437b-857d-1cb79be8cab2 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:57.518252 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a6c04ba7-3d3c-44ab-b46d-5db07c4a6d03 req-2803c74f-fb7d-437b-857d-1cb79be8cab2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:57.519194 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a6c04ba7-3d3c-44ab-b46d-5db07c4a6d03 req-2803c74f-fb7d-437b-857d-1cb79be8cab2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:57.531898 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-a6c04ba7-3d3c-44ab-b46d-5db07c4a6d03 req-2803c74f-fb7d-437b-857d-1cb79be8cab2 service nova] Creating event network-vif-deleted:096dd53a-4e6c-4db9-8564-fd9f67a455e7 for instance b0298df5-f99f-4390-8f6f-3320fdfaff52 on hv-cinder-85427 Aug 24 06:46:57.538079 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-a6c04ba7-3d3c-44ab-b46d-5db07c4a6d03 req-2803c74f-fb7d-437b-857d-1cb79be8cab2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037109 Aug 24 06:46:57.539630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 353/686] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:46:57.852977 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:57.861965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-702d3c36-8ca6-4dd4-b85b-a1e6bdcfdd46 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.421820 Aug 24 06:46:57.862548 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 334/687] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:57 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:57.984884 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:57.985664 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:57.988003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:57.994605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:57.995198 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:57.995638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:57.996336 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:57.996777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:57.997219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:58.031674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:58.032155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:58.032583 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:58.033038 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lazy-loading 'fault' on Instance uuid b0298df5-f99f-4390-8f6f-3320fdfaff52 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:46:58.082147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:58.093968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5cc71339-1fc5-425d-a8be-d95ac651807d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 200 len: 1332 microversion: 2.1 time: 0.113288 Aug 24 06:46:58.094553 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 354/688] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:57 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:58.884731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:58.885392 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:58.891732 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:58.892243 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:58.892668 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:58.893377 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:58.893840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:58.894236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:59.025710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:59.039154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-40b63bb9-d94d-47f9-8d18-34915c222726 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.158860 Aug 24 06:46:59.039718 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 335/689] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:58 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:59.125681 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:59.126352 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:59.132935 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:59.133445 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:59.133891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:59.134641 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:59.135144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:59.135505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:59.149096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 HTTP/1.1 Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:46:59.150734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:46:59.152114 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': 'b0298df5-f99f-4390-8f6f-3320fdfaff52'} Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:46:59.152814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:46:59.154140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:46:59.155362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:46:59.155362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-507a27ce-78ec-491e-9eb3-33f2eb0d702f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 404 len: 111 microversion: 2.1 time: 0.030425 Aug 24 06:46:59.155362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 355/690] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:59 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:46:59.160814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-92153fe5-a4bd-43af-95df-4a42d164bae6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '.version_select at 0x7fb5d44f09d0>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:59.230630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-92153fe5-a4bd-43af-95df-4a42d164bae6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129889213" status: 202 len: 0 microversion: 2.1 time: 0.073436 Aug 24 06:46:59.231311 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 336/691] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 24 06:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129889213 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:47:00.058905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-57538555-6058-481d-a2a4-fac36c3b7b5e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: .version_select at 0x7fb5d4643310>, body: {"keypair": {"name": "tempest-keypair-242240487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg257geXnGXhItTwjaZUHCM6Bumr0MZHUuz/iQRgLBed2c+8u+kBzxSGIEiIPHZMt+WxutjeRP5CgQXCLidzeWnZUeFFDphO6NeNrvBfudVLF5Ci1y2ebSCyafuq/9qSA=="}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:00.062890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:00.063542 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:00.070359 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:00.070849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:00.071319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:00.072038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:00.072507 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:00.072937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:00.078181 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-57538555-6058-481d-a2a4-fac36c3b7b5e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for project b91004b0497d487ea8f1f454c03bbca0. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:47:00.082140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-57538555-6058-481d-a2a4-fac36c3b7b5e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for user 02ad6cdc4ffe4917a7bbf6814297f980 and project b91004b0497d487ea8f1f454c03bbca0. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:47:00.094508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-57538555-6058-481d-a2a4-fac36c3b7b5e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [d0b04d7c-0a96-46e5-aff5-6a112e1d3530] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:47:00.207337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:00.215808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-93337af9-65ff-4f88-85c2-e9da6c7ee0f2 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.157471 Aug 24 06:47:00.216369 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 337/692] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:00 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:01.102814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO oslo.messaging._drivers.impl_rabbit [None req-57538555-6058-481d-a2a4-fac36c3b7b5e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [d0b04d7c-0a96-46e5-aff5-6a112e1d3530] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54534. Aug 24 06:47:01.201006 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-57538555-6058-481d-a2a4-fac36c3b7b5e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.146719 Aug 24 06:47:01.201637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 356/693] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:47:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:01.237108 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:01.237767 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:01.240152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:01.245199 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:01.245691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:01.246125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:01.246809 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:01.247258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:01.247678 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:01.381697 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:01.396800 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a480309c-32c4-4d12-b614-97aa0d78a003 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.163342 Aug 24 06:47:01.397853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 338/694] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:01 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:02.428838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:02.429496 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:02.437092 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:02.437630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:02.438066 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:02.438765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:02.439219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:02.439647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:02.572712 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:02.573415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:02.580212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:02.580700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:02.581131 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:02.581861 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:02.582315 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:02.582735 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:02.615343 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:47:02.635668 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:02.649282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-83b86840-e84c-4e93-9aea-54d430bb3483 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.230567 Aug 24 06:47:02.650635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 357/695] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:02 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:02.957581 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b1100103-5f9b-42b6-880f-d0d58a7e0c94 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 204 len: 0 microversion: 2.1 time: 0.388800 Aug 24 06:47:02.958263 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 339/696] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:47:02 2022] DELETE /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:47:02.967651 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:02.968324 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:02.974829 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:02.975396 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:02.975911 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:02.976670 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:02.977122 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:02.977562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:03.164368 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:03.173242 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c21ccd9f-8a4e-4645-987f-d7edd59da57d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1579 microversion: 2.1 time: 0.210571 Aug 24 06:47:03.173914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 358/697] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:02 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1579 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:03.536058 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1820145677", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14e1d9b8-7d9c-4824-8559-f6d63d615d5b"}], "security_groups": [{"name": "tempest-securitygroup--722172545"}], "key_name": "tempest-keypair-242240487", "user_data": "}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:03.640398 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] validate_networks() for [('14e1d9b8-7d9c-4824-8559-f6d63d615d5b', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:47:03.672644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:03.673271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:03.679705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:03.680182 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:03.680626 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:03.682031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:03.682694 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:03.682893 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:03.818658 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:03.827916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9c88a919-9d4b-4687-b582-f4f11641354c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.159266 Aug 24 06:47:03.828569 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 359/698] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:03 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:04.066905 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:47:04.067266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:47:04.067730 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:47:04.068132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:47:04.068534 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:47:04.077525 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.077993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.078417 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.079125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.079568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.080069 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.086760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:04.097528 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for project b91004b0497d487ea8f1f454c03bbca0. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:47:04.101432 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for user 02ad6cdc4ffe4917a7bbf6814297f980 and project b91004b0497d487ea8f1f454c03bbca0. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:47:04.113578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:47:04.116069 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:47:04.194998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:04.195620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:04.201647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.202126 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.202566 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.203225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.203667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.204074 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.269093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5c1b6cab-8981-46d0-a82a-36724fce975c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.737657 Aug 24 06:47:04.270047 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 340/699] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:47:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:47:04.281132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8218d05f-083f-4dde-8401-ee03f5b14567 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:04.281769 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8218d05f-083f-4dde-8401-ee03f5b14567 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:04.343137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:04.344373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8218d05f-083f-4dde-8401-ee03f5b14567 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:04.351909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8218d05f-083f-4dde-8401-ee03f5b14567 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1241 microversion: 2.1 time: 0.074630 Aug 24 06:47:04.357663 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 341/700] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:04 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:04.357784 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c72b2785-9997-47b8-bbeb-554e06ecb550 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1579 microversion: 2.1 time: 0.162745 Aug 24 06:47:04.357784 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 360/701] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:04 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:04.805564 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-475a267e-f228-4ba2-bae9-6f9a78e13847 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:04.806797 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-475a267e-f228-4ba2-bae9-6f9a78e13847 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:04.813020 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-475a267e-f228-4ba2-bae9-6f9a78e13847 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.813529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-475a267e-f228-4ba2-bae9-6f9a78e13847 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.813952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-475a267e-f228-4ba2-bae9-6f9a78e13847 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.814626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-475a267e-f228-4ba2-bae9-6f9a78e13847 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.815067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-475a267e-f228-4ba2-bae9-6f9a78e13847 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.815479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-475a267e-f228-4ba2-bae9-6f9a78e13847 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.849828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:04.851185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:04.854828 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-475a267e-f228-4ba2-bae9-6f9a78e13847 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments/a272ca82-54e1-4d84-8389-7082ffa9519f" status: 200 len: 194 microversion: 2.20 time: 0.053189 Aug 24 06:47:04.855875 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 342/702] 10.222.0.47 () {60 vars in 1454 bytes} [Wed Aug 24 06:47:04 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments/a272ca82-54e1-4d84-8389-7082ffa9519f => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:47:04.858767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.859328 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.859824 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.860602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.861538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.863894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.926815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:04.927487 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:04.934395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.934962 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.935462 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.938435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.938435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.938435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:05.015860 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:05.028253 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a90ae3d5-d25d-4844-99ba-82a4b30cf299 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.182348 Aug 24 06:47:05.029171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 361/703] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:04 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:05.075347 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lazy-loading 'services' on Instance uuid fa5949cc-2133-40b8-9112-b5d571c05f9d {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:47:05.314746 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0d8441f4-1ef1-4987-b421-06d75450cd58 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments/a272ca82-54e1-4d84-8389-7082ffa9519f" status: 202 len: 0 microversion: 2.20 time: 0.391073 Aug 24 06:47:05.318496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 343/704] 10.222.0.47 () {60 vars in 1457 bytes} [Wed Aug 24 06:47:04 2022] DELETE /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments/a272ca82-54e1-4d84-8389-7082ffa9519f => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:47:05.323538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7089ef27-57b3-475c-ab60-063587015a6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:05.326696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7089ef27-57b3-475c-ab60-063587015a6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:05.336605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7089ef27-57b3-475c-ab60-063587015a6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:05.338973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7089ef27-57b3-475c-ab60-063587015a6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:05.339536 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7089ef27-57b3-475c-ab60-063587015a6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:05.340464 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7089ef27-57b3-475c-ab60-063587015a6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:05.340986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7089ef27-57b3-475c-ab60-063587015a6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:05.341501 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7089ef27-57b3-475c-ab60-063587015a6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:05.370459 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:05.375915 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7089ef27-57b3-475c-ab60-063587015a6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056464 Aug 24 06:47:05.377169 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 362/705] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 24 06:47:05 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:47:05.377386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-dc48a3fd-2843-400f-9c47-8dd3fdd26727 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:05.383168 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-dc48a3fd-2843-400f-9c47-8dd3fdd26727 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:05.383372 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:05.383372 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:05.389660 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:05.390287 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:05.390822 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:05.391616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:05.392298 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:05.393031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:05.529770 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-dc48a3fd-2843-400f-9c47-8dd3fdd26727 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:05.543317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-dc48a3fd-2843-400f-9c47-8dd3fdd26727 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1241 microversion: 2.1 time: 0.173046 Aug 24 06:47:05.544618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 344/706] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:05 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:05.556806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:05.568884 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-52169260-4ca6-4c10-b72d-09991838d6d3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1579 microversion: 2.1 time: 0.190360 Aug 24 06:47:05.570035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 363/707] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:05 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1579 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:05.986340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-23447a1d-272d-471f-b391-c8c9dc57b0af req-6e4ab0a8-ed8c-4f8a-b078-7d47d9725b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4", "name": "network-vif-deleted", "tag": "4d0ce8d9-4180-4c13-aa4c-06f7261b493c"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:05.998374 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-23447a1d-272d-471f-b391-c8c9dc57b0af req-6e4ab0a8-ed8c-4f8a-b078-7d47d9725b46 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:05.998849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-23447a1d-272d-471f-b391-c8c9dc57b0af req-6e4ab0a8-ed8c-4f8a-b078-7d47d9725b46 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:05.999275 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-23447a1d-272d-471f-b391-c8c9dc57b0af req-6e4ab0a8-ed8c-4f8a-b078-7d47d9725b46 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:06.011222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-23447a1d-272d-471f-b391-c8c9dc57b0af req-6e4ab0a8-ed8c-4f8a-b078-7d47d9725b46 service nova] Creating event network-vif-deleted:4d0ce8d9-4180-4c13-aa4c-06f7261b493c for instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 on hv-cinder-85427 Aug 24 06:47:06.016531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-23447a1d-272d-471f-b391-c8c9dc57b0af req-6e4ab0a8-ed8c-4f8a-b078-7d47d9725b46 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034020 Aug 24 06:47:06.017467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 345/708] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:06.053502 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:06.055012 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:06.065523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:06.066343 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:06.067444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:06.068971 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:06.069631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:06.072611 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:06.247259 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:06.259896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2aba16ff-7e38-4c51-a7d9-6ec1b8ac9bfc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.207435 Aug 24 06:47:06.259896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 364/709] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:06 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:06.390239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1da2d00e-26c1-4a6d-ae98-197b03b5d723 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:06.392524 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1da2d00e-26c1-4a6d-ae98-197b03b5d723 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:06.399280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1da2d00e-26c1-4a6d-ae98-197b03b5d723 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:06.399825 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1da2d00e-26c1-4a6d-ae98-197b03b5d723 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:06.400269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1da2d00e-26c1-4a6d-ae98-197b03b5d723 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:06.400974 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1da2d00e-26c1-4a6d-ae98-197b03b5d723 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:06.401963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1da2d00e-26c1-4a6d-ae98-197b03b5d723 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:06.402411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1da2d00e-26c1-4a6d-ae98-197b03b5d723 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:06.439595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1da2d00e-26c1-4a6d-ae98-197b03b5d723 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050279 Aug 24 06:47:06.439595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 346/710] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 24 06:47:06 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:47:06.566330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3924553f-b44a-42fb-9748-ee950fefc2de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:06.566966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3924553f-b44a-42fb-9748-ee950fefc2de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:06.593671 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:06.594310 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:06.603845 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:06.606274 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:06.607480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:06.618881 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:06.620556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:06.622480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:06.647941 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3924553f-b44a-42fb-9748-ee950fefc2de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:06.658532 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3924553f-b44a-42fb-9748-ee950fefc2de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1241 microversion: 2.1 time: 0.096064 Aug 24 06:47:06.669735 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 365/711] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:06 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:06.742075 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:06.751597 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-65f3abbf-d334-4a7d-9292-7f3d6d5c0650 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 200 len: 1226 microversion: 2.1 time: 0.164760 Aug 24 06:47:06.752174 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 347/712] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:06 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 1226 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:07.280097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:07.280097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:07.285745 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.286224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.286658 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:07.287345 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.287791 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.288243 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:07.419235 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:07.428057 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-592c6eba-b363-4d98-882c-3a9882538220 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.153543 Aug 24 06:47:07.434127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 366/713] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:07 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:07.448198 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e6de0dc9-b7e6-4b28-8e0e-9635cb5d47f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:07.450675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e6de0dc9-b7e6-4b28-8e0e-9635cb5d47f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:07.457328 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6de0dc9-b7e6-4b28-8e0e-9635cb5d47f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.457820 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6de0dc9-b7e6-4b28-8e0e-9635cb5d47f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.458265 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6de0dc9-b7e6-4b28-8e0e-9635cb5d47f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:07.459003 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6de0dc9-b7e6-4b28-8e0e-9635cb5d47f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.459459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6de0dc9-b7e6-4b28-8e0e-9635cb5d47f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.459940 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6de0dc9-b7e6-4b28-8e0e-9635cb5d47f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:07.492544 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e6de0dc9-b7e6-4b28-8e0e-9635cb5d47f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049618 Aug 24 06:47:07.493243 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 348/714] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 24 06:47:07 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:07.560013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:07.566239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:07.566697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.567199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.567627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:07.568333 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.568780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.569230 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:07.596093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:47:07.683247 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-36f34f80-eb11-441f-9dc7-8ba393649e9a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:07.684222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-36f34f80-eb11-441f-9dc7-8ba393649e9a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:07.742178 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-36f34f80-eb11-441f-9dc7-8ba393649e9a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:07.753741 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-36f34f80-eb11-441f-9dc7-8ba393649e9a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1241 microversion: 2.1 time: 0.071973 Aug 24 06:47:07.753741 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 349/715] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:07 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:07.771933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:07.772533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:07.778778 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.779261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.779693 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:07.780392 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.780839 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.781288 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:07.798609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] HTTP exception thrown: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Request method failure captured: Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 HTTP/1.1 Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBchkSl4oz5nY3GuAuyFTXBSXbOhabGlIuSSWl3zqKGvC44Qyb9ZYmrnMJ2z5wHu-GuZoz7oATwKWC099aeY4NPDNlx2gsQvrG2lJHV_SnbqM9Cj1icV-GWyXT0OrTSzFZau4IMHss-TobIDvEK0gqhSt0R1Y6WlQE89b5IpiTOZEvWg Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: a97277d100304d6aa689f73174562474 Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:47:07.800319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a97277d100304d6aa689f73174562474"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a97277d100304d6aa689f73174562474", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: a97277d100304d6aa689f73174562474 Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 594e9324c44540568a81fd5fdb980efb Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:47:07.801833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4'} Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:07.802681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:47:07.803957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:07.805118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Returning 404 to user: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:07.805118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-48097085-5b16-4929-af4e-ea47cc715c80 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 404 len: 111 microversion: 2.1 time: 0.033711 Aug 24 06:47:07.805118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 350/716] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:07 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:47:07.906129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2008036379", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1329256554", "security_groups": [{"name": "tempest-secgroup-smoke-1486398605"}], "block_device_mapping_v2": [{"uuid": "50bc538f-df62-4dfb-bcc8-8f931889fd9f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "27d7c166-db17-4e73-a5c2-606d6229bd9b"}]}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:07.919621 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ef22f7de-0225-476e-bb20-604aa2951d93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 204 len: 0 microversion: 2.20 time: 0.364147 Aug 24 06:47:07.920288 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 367/717] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 24 06:47:07 2022] DELETE /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 06:47:07.931793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:07.931793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:07.937897 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.938388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.938911 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:07.939522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:07.940028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:07.940447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:08.030086 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] validate_networks() for [('27d7c166-db17-4e73-a5c2-606d6229bd9b', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:47:08.094483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:08.105787 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:08.107414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:08.108825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c507d98a-4b8d-4f09-b40f-9be6d5bf7c6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.183947 Aug 24 06:47:08.109589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 368/718] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:07 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:08.421862 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:47:08.422281 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:47:08.422749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:47:08.423151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:47:08.423559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:47:08.433625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:08.434102 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:08.434529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:08.435299 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:08.435750 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:08.436180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:08.451363 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:08.451970 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:08.455619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Getting quotas for project a97277d100304d6aa689f73174562474. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:47:08.458312 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:08.458781 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:08.459206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:08.459672 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Getting quotas for user 594e9324c44540568a81fd5fdb980efb and project a97277d100304d6aa689f73174562474. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:47:08.459994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:08.460446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:08.460953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:08.524037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:47:08.527085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50bc538f-df62-4dfb-bcc8-8f931889fd9f',volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:47:08.603409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:08.611737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-33511d31-8ac9-495c-90d4-c72f12d48857 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.165067 Aug 24 06:47:08.612289 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 369/719] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:08 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:08.771471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:08.771990 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:08.778878 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:08.779349 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:08.779775 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:08.780595 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:08.781036 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:08.782448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:08.847061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:08.855378 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d4a97d72-679a-4bdf-a696-1fe4057ab804 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1245 microversion: 2.1 time: 0.087820 Aug 24 06:47:08.855979 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 370/720] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:08 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:09.101799 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f8c6857b-8f98-4c6c-ba79-51797e60395c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.199357 Aug 24 06:47:09.102348 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 351/721] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:47:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:47:09.114051 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8200dfac-0c6a-487b-a117-be67956c2e96 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:09.114682 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8200dfac-0c6a-487b-a117-be67956c2e96 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:09.137265 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:09.138335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:09.147083 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:09.147684 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:09.148181 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:09.149134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:09.150066 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:09.150066 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:09.183962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8200dfac-0c6a-487b-a117-be67956c2e96 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:09.192202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8200dfac-0c6a-487b-a117-be67956c2e96 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1095 microversion: 2.1 time: 0.081958 Aug 24 06:47:09.192738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 371/722] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:09 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:09.298188 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:09.307909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:09.309745 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:09.310914 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8c175661-0e3d-4faa-ae74-78c462917c8c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.180758 Aug 24 06:47:09.311734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 352/723] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:09 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:09.634416 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:09.635260 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:09.643618 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:09.644625 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:09.645155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:09.646089 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:09.646747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:09.647348 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:09.784845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:09.794447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-53f1fe9a-db85-4454-96c6-664b3d5f8765 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.164087 Aug 24 06:47:09.795022 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 372/724] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:09 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:09.881357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:09.881908 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:09.889452 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:09.889932 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:09.890364 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:09.891044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:09.891492 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:09.891906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:09.958050 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:09.965878 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0f657da7-a749-432e-806d-dab9c8c284b4 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1245 microversion: 2.1 time: 0.088501 Aug 24 06:47:09.966529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 353/725] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:09 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:10.213453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:10.214110 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:10.220370 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:10.220858 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:10.221567 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:10.222251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:10.222692 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:10.223105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:10.284182 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:10.293225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-fb367273-4aba-48dc-ab1c-317dd7cf890b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1145 microversion: 2.1 time: 0.083793 Aug 24 06:47:10.293794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 373/726] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:10 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:10.334204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:10.334806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:10.341647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:10.342129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:10.342559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:10.343254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:10.343954 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:10.344107 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:10.480173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:10.488470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:10.490026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:10.491170 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8d1d1adb-265a-49e0-9cc1-9af8ae222fd1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.160833 Aug 24 06:47:10.491725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 354/727] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:10 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:10.816104 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:10.816650 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:10.823875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:10.824386 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:10.824840 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:10.825626 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:10.826072 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:10.826493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:10.959875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:10.969159 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e419bfea-882b-4a86-9a4a-3cc4a048ea07 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.156951 Aug 24 06:47:10.969756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 374/728] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:10 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:10.987052 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:10.987662 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:10.994433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:10.995066 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:10.995494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:10.996180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:10.996713 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:10.997130 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:11.057806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:11.065387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3639adf6-b078-4066-971c-07a3bd290349 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1245 microversion: 2.1 time: 0.082303 Aug 24 06:47:11.065944 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 355/729] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:10 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:11.314261 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:11.314858 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:11.320783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:11.321303 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:11.321731 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:11.322415 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:11.324128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:11.324553 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:11.389326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:11.398447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1662a231-5aad-4aa6-9d29-ed1842651202 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1145 microversion: 2.1 time: 0.087981 Aug 24 06:47:11.399366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 375/730] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:11 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:11.515923 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:11.516907 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:11.522935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:11.523641 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:11.524071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:11.525808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:11.526592 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:11.527111 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:11.775320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:11.784066 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:11.789278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:11.795149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b5bbe8b6-d61f-4584-99f5-1d202610624a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1724 microversion: 2.20 time: 0.278724 Aug 24 06:47:11.795149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 356/731] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:11 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:11.991359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:11.991986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:11.999519 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:11.999997 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:12.000449 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:12.001120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:12.001610 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:12.002004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:12.087154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:12.087762 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:12.094653 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:12.095137 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:12.095563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:12.096497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:12.097048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:12.097572 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:12.152185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:12.160823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-132ad836-fe9a-4977-ad76-662055a2ecff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.173383 Aug 24 06:47:12.161462 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 376/732] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:11 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:12.167627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:12.175540 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-af052b45-1ed9-4e1f-aa6a-90f32ee531ea tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1293 microversion: 2.1 time: 0.092259 Aug 24 06:47:12.176113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 357/733] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:12 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:12.419911 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:12.420526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:12.426735 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:12.427218 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:12.427645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:12.429115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:12.429115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:12.430090 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:12.512274 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:12.522191 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-004961bb-060e-42c8-aad5-92035c26aab1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1193 microversion: 2.1 time: 0.106828 Aug 24 06:47:12.527631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 377/734] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:12 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:12.528351 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-15a3b879-194d-4aa0-b07b-908d84b7cebd req-94e65caa-19c0-488d-82b2-04c3ae1ba53f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5949cc-2133-40b8-9112-b5d571c05f9d", "name": "network-vif-deleted", "tag": "e60cb872-95c0-4edd-942a-e19544fba59a"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:12.538905 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-15a3b879-194d-4aa0-b07b-908d84b7cebd req-94e65caa-19c0-488d-82b2-04c3ae1ba53f service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:12.539518 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-15a3b879-194d-4aa0-b07b-908d84b7cebd req-94e65caa-19c0-488d-82b2-04c3ae1ba53f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:12.539948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-15a3b879-194d-4aa0-b07b-908d84b7cebd req-94e65caa-19c0-488d-82b2-04c3ae1ba53f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:12.552208 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-15a3b879-194d-4aa0-b07b-908d84b7cebd req-94e65caa-19c0-488d-82b2-04c3ae1ba53f service nova] Creating event network-vif-deleted:e60cb872-95c0-4edd-942a-e19544fba59a for instance fa5949cc-2133-40b8-9112-b5d571c05f9d on hv-cinder-85427 Aug 24 06:47:12.558008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-15a3b879-194d-4aa0-b07b-908d84b7cebd req-94e65caa-19c0-488d-82b2-04c3ae1ba53f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035395 Aug 24 06:47:12.559551 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 358/735] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:12.814646 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:12.815251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:12.821738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:12.822225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:12.822739 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:12.823494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:12.823946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:12.824361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:12.892128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:12.907408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:12.908915 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:12.910201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-681e28c4-ad16-4e1c-b32f-b4171e4c04ae tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1657 microversion: 2.20 time: 0.099586 Aug 24 06:47:12.918420 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 378/736] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:12 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1657 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:13.184806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:13.185637 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:13.192378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.192857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.193320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.194178 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.194631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.195050 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.198290 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:13.198871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:13.205521 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.206228 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.206855 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.207974 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.208586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.209014 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.286116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:13.289638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:13.294395 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f2fe680b-de38-4fd6-be35-16af2873c7de tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1293 microversion: 2.1 time: 0.101068 Aug 24 06:47:13.294968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 379/737] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:13 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:13.345631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:13.355681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e9532397-27d5-4fc7-a08f-2a6da5607067 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1735 microversion: 2.1 time: 0.175255 Aug 24 06:47:13.356289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 359/738] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:13 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:13.545919 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:13.546523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:13.553761 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.554249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.554678 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.555522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.555971 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.556386 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.622910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:13.630968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-520c7ec5-d17c-4c43-ad1e-417d9a1b0fce tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1201 microversion: 2.1 time: 0.090756 Aug 24 06:47:13.631638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 380/739] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:13 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:13.935944 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:13.936546 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:13.942793 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.946060 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.946060 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.946060 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.946060 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.946429 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.977678 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.978167 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.978599 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.979579 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lazy-loading 'fault' on Instance uuid fa5949cc-2133-40b8-9112-b5d571c05f9d {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:47:14.064965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:14.076387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:14.077952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:14.079513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-36a8d80a-dda4-47ab-9a5f-91d2785a9370 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 200 len: 1371 microversion: 2.20 time: 0.148061 Aug 24 06:47:14.080075 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 360/740] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:13 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:14.314509 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:14.315136 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:14.322100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.322641 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.323263 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.324050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.324524 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.325036 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.379984 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:14.380604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:14.388172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.388732 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.389336 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.390179 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.390891 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.391599 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.432403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:14.444294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3b0b6083-766c-4cb9-b612-a758cb7cf07a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1311 microversion: 2.1 time: 0.133861 Aug 24 06:47:14.445223 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 381/741] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:14 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:14.654900 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:14.655986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:14.664311 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.664827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.666934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.667740 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.668208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.668645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.699530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:14.720857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fd3df0f8-cd53-4b3a-afa9-c11f3022103b tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1715 microversion: 2.1 time: 0.347200 Aug 24 06:47:14.733885 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 361/742] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:14 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1715 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:14.740809 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:14.748368 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b3882309-fc9f-44e5-ab53-7133b840f52a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1211 microversion: 2.1 time: 0.098452 Aug 24 06:47:14.748954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 382/743] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:14 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:14.837003 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:14.837558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:14.846890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.848154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.848607 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.849590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.850331 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.850987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.856428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:14.941620 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] HTTP exception thrown: Cannot 'detach_volume' instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 while it is in vm_state rescued Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Request method failure captured: Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments/59b93249-085e-43d4-94a6-ad144874cd76 HTTP/1.1 Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBchMQjcmjijIBhpNwhXBtxs1VYqlxbDph_btSBqtQJD0W420IcVXlkq_bxPzo9Wo0IAQ0x7-Rc5rZFp87wdxqiPq9b8-SlxrXff7vRJvQ8OS4DfdDyvZmhbpacyJWfoSCxJ4jHaBYaZmu0BXGlG7tEmEDNtFuu-zYjfP3jWErKuEk_I Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:47:14.943342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50896ec327454f28b1987cd4271b6e27", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 026744699ed54dce8dc240e44e8aefb3 Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:47:14.944844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Cannot 'detach_volume' instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 while it is in vm_state rescued Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'server_id': 'ee546bf2-d24c-41cb-925a-b8c8ddd29697', 'id': '59b93249-085e-43d4-94a6-ad144874cd76'} Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:14.945675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 while it is in vm_state rescued Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 while it is in vm_state rescued Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:14.947422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Returning 409 to user: Cannot 'detach_volume' instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 while it is in vm_state rescued {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:14.949649 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ed373699-ed66-45b6-8d34-15a8648a6316 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments/59b93249-085e-43d4-94a6-ad144874cd76" status: 409 len: 152 microversion: 2.1 time: 0.112086 Aug 24 06:47:14.950411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 362/744] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:47:14 2022] DELETE /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments/59b93249-085e-43d4-94a6-ad144874cd76 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 06:47:14.958916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c1b03151-1972-486e-92ba-dbf8003ec4e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:14.959590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c1b03151-1972-486e-92ba-dbf8003ec4e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:14.967292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1b03151-1972-486e-92ba-dbf8003ec4e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.967778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1b03151-1972-486e-92ba-dbf8003ec4e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.968249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1b03151-1972-486e-92ba-dbf8003ec4e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.969210 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1b03151-1972-486e-92ba-dbf8003ec4e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.969653 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1b03151-1972-486e-92ba-dbf8003ec4e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.970073 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1b03151-1972-486e-92ba-dbf8003ec4e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.115171 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:15.115789 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:15.124666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.125161 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.125617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.126380 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.126890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.127309 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.142561 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] HTTP exception thrown: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Request method failure captured: Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d HTTP/1.1 Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfy7p4tsltEbE1yh4M2yRaU4yx7GTB4GuYO-1q67SnWqXEpRsvL3hrxx1W8aH8kmAXQvvejnH7vpJR_sWM2t-lQnYJRyvUg6A0ZaxgkGDGW7zm5YyScCHB5TIIurkjw2haDAaUr3nijSCchE29A1NTLS80cR1EWYJViA5WH7DWZzvU Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:47:15.144118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e1bf995c8c544dc29f42e53866cc6bd2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 52f796d5013d4a31b107fb86c5523c9c Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:47:15.145654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'fa5949cc-2133-40b8-9112-b5d571c05f9d'} Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:15.146433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:47:15.147574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:15.148684 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Returning 404 to user: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:15.148684 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-42933d06-f46e-4772-8ba6-4f93ceda8ee8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 404 len: 111 microversion: 2.20 time: 0.034539 Aug 24 06:47:15.148684 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 363/745] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:15 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:47:15.155495 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-938bb858-36e8-40c1-892d-5aae98eb87f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '.version_select at 0x7fb5d43bfb80>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:15.169758 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:15.269637 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-938bb858-36e8-40c1-892d-5aae98eb87f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-556350054" status: 204 len: 0 microversion: 2.20 time: 0.118771 Aug 24 06:47:15.271269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 364/746] 10.222.0.47 () {60 vars in 1259 bytes} [Wed Aug 24 06:47:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-556350054 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 06:47:15.274680 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c1b03151-1972-486e-92ba-dbf8003ec4e1 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "POST /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/action" status: 202 len: 0 microversion: 2.1 time: 0.320394 Aug 24 06:47:15.274680 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 383/747] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:47:14 2022] POST /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:47:15.283037 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:15.283726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:15.290120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.290732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.291161 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.292395 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.292833 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.293279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.459480 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:15.469513 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-48568c36-de2c-4b66-ae71-98a70353f352 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1723 microversion: 2.1 time: 0.190599 Aug 24 06:47:15.469733 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:15.470419 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:15.482686 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.483333 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 384/748] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:15 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:15.484060 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.484722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.485955 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.486817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.487330 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.629408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:15.637245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e3182a92-058b-4284-9092-0576ed9f9d82 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1299 microversion: 2.1 time: 0.174341 Aug 24 06:47:15.637845 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 365/749] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:15 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:15.770475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:15.771080 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:15.778796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.779448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.779883 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.780578 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.781031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.781488 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.847784 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:15.856636 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6499636e-ecf8-4242-8e95-6f2445ba6db3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1211 microversion: 2.1 time: 0.090042 Aug 24 06:47:15.857229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 385/750] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:15 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:16.503219 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:16.504620 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:16.508558 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-31a9a032-6f0b-4377-8a69-56f0c49f4040 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'create', calling method: .version_select at 0x7fb5d8e0ba60>, body: {"keypair": {"name": "tempest-keypair-1665440967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVDK56SsaY+DrLXDloIlkhPJUfiONIamToWKdtU2qHDrBlcM02vGLSJoFUhfGgsVXyo6jdBTok6BhPbVBuzbpSt1+LbpzvEffP2iby5U+e+wGG03ZcOcM9qL+vBI2hZMg=="}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:16.514017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:16.514759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:16.515406 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:16.516477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:16.517137 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:16.517824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:16.527638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-31a9a032-6f0b-4377-8a69-56f0c49f4040 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Getting quotas for project e1bf995c8c544dc29f42e53866cc6bd2. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:47:16.532135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-31a9a032-6f0b-4377-8a69-56f0c49f4040 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Getting quotas for user 52f796d5013d4a31b107fb86c5523c9c and project e1bf995c8c544dc29f42e53866cc6bd2. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:47:16.617998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-31a9a032-6f0b-4377-8a69-56f0c49f4040 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.113643 Aug 24 06:47:16.618902 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 386/751] 10.222.0.47 () {62 vars in 1200 bytes} [Wed Aug 24 06:47:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 06:47:16.660786 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:16.661406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:16.668918 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:16.668918 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:16.669592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:16.670735 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:16.670994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:16.671616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:16.840554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:16.850526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2d54ddaf-500d-4d74-a79f-2a4c5b07318b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.193585 Aug 24 06:47:16.851882 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 387/752] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:16 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:16.878483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:16.879009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:16.882034 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:16.886355 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:16.887019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:16.887453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:16.888364 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:16.888817 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:16.889254 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:16.902221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:16.913462 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a454b6a9-deed-4939-b700-69aaa20372b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1723 microversion: 2.1 time: 0.423785 Aug 24 06:47:16.914371 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 366/753] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:16 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:17.062393 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:17.071944 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e850d6bc-170a-4446-8ca7-d39dc9b3f2d2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.198324 Aug 24 06:47:17.072762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 388/754] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:16 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:17.589123 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1198897200"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:17.589711 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:17.596609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:17.597090 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:17.600257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:17.600257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:17.600257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:17.600257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:17.693018 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-309b87b8-658d-4ed6-8894-900c574e9c1f req-98f7fb3b-4f95-454f-814e-67a3f13ad1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086395fc-028c-495d-993a-8fee70809181", "tag": "3a5db911-d33c-4154-8327-fcf2006fa1a4"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:17.710276 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-309b87b8-658d-4ed6-8894-900c574e9c1f req-98f7fb3b-4f95-454f-814e-67a3f13ad1d4 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:17.711299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-309b87b8-658d-4ed6-8894-900c574e9c1f req-98f7fb3b-4f95-454f-814e-67a3f13ad1d4 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:17.712225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-309b87b8-658d-4ed6-8894-900c574e9c1f req-98f7fb3b-4f95-454f-814e-67a3f13ad1d4 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:17.725505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-309b87b8-658d-4ed6-8894-900c574e9c1f req-98f7fb3b-4f95-454f-814e-67a3f13ad1d4 service nova] Creating event network-changed:3a5db911-d33c-4154-8327-fcf2006fa1a4 for instance 086395fc-028c-495d-993a-8fee70809181 on hv-cinder-85427 Aug 24 06:47:17.730824 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-309b87b8-658d-4ed6-8894-900c574e9c1f req-98f7fb3b-4f95-454f-814e-67a3f13ad1d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042261 Aug 24 06:47:17.737800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 389/755] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:17.854618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.network.security_group_api [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Removing security group 36352548-bc4d-42d8-8796-8c8d1725de65 from port 4c9b237a-0d94-4b19-8954-bbc3140f2b84 Aug 24 06:47:17.873414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:17.874126 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:17.880587 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:17.881133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:17.881580 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:17.882319 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:17.884394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:17.884394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.033772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:18.047671 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-be0e4377-69c2-43a2-ab45-40fe1aca5168 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.178625 Aug 24 06:47:18.048721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 390/756] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:17 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:18.057425 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:18.058685 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:18.066462 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.066938 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.067366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.068050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.068493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.068906 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.206650 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:18.215717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-04166c92-2232-4048-a235-99d6d76a84ae tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1723 microversion: 2.1 time: 0.165526 Aug 24 06:47:18.216299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 391/757] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:18 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:18.220938 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:18.221927 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:18.227941 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.228485 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.228942 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.229663 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.230111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.230781 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.368061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:18.372771 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d6b88b4f-4aff-49a0-89ff-f65aeadab5ce tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "POST /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/action" status: 202 len: 0 microversion: 2.1 time: 0.787995 Aug 24 06:47:18.374332 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 367/758] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:47:17 2022] POST /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:47:18.378080 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a0dfcda8-4764-4b7f-8456-f05706a896e2 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.160300 Aug 24 06:47:18.387741 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 392/759] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:18 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:19.066745 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=4 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:19.067511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=18 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:19.071879 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:19.072508 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:19.078955 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:19.079436 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:19.079872 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:19.080569 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:19.081019 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:19.081463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:19.236731 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:19.237542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:19.245483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:19.246303 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:19.246801 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:19.247560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:19.248076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:19.248565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:19.386507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:19.395116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7454b19b-6362-49b6-9960-331b42545085 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1723 microversion: 2.1 time: 0.162502 Aug 24 06:47:19.395708 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 393/760] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:19 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:19.400480 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:19.401439 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:19.407740 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:19.411556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:19.411556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:19.411556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:19.411556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:19.411894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:19.473816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:19.483280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0db92d8d-ca26-46f3-92ab-575602045b89 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.417246 Aug 24 06:47:19.484460 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 368/761] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:19 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:19.560879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:19.569810 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7bcd425d-32f4-4073-a331-3e04e8696d1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.172871 Aug 24 06:47:19.570396 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 394/762] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:19 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:19.756629 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-4734d9a8-6dfa-4266-b788-6d04485f94b5 req-424b321a-e6af-478e-962a-e418e4e2d8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e19365c-8664-4f9a-bd20-ff53faa8f495", "tag": "83213354-63ee-4dfa-bbb7-7105246d4dc8"}, {"name": "network-changed", "server_uuid": "3ed98f99-0b60-4284-b252-931aa0e4adcc", "tag": "4c9b237a-0d94-4b19-8954-bbc3140f2b84"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:19.767879 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-4734d9a8-6dfa-4266-b788-6d04485f94b5 req-424b321a-e6af-478e-962a-e418e4e2d8db service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:19.768349 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-4734d9a8-6dfa-4266-b788-6d04485f94b5 req-424b321a-e6af-478e-962a-e418e4e2d8db service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:19.768769 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-4734d9a8-6dfa-4266-b788-6d04485f94b5 req-424b321a-e6af-478e-962a-e418e4e2d8db service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:19.782969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-4734d9a8-6dfa-4266-b788-6d04485f94b5 req-424b321a-e6af-478e-962a-e418e4e2d8db service nova] Creating event network-changed:83213354-63ee-4dfa-bbb7-7105246d4dc8 for instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 on hv-cinder-85427 Aug 24 06:47:19.783538 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-4734d9a8-6dfa-4266-b788-6d04485f94b5 req-424b321a-e6af-478e-962a-e418e4e2d8db service nova] Creating event network-changed:4c9b237a-0d94-4b19-8954-bbc3140f2b84 for instance 3ed98f99-0b60-4284-b252-931aa0e4adcc on hv-cinder-85427 Aug 24 06:47:19.790297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-4734d9a8-6dfa-4266-b788-6d04485f94b5 req-424b321a-e6af-478e-962a-e418e4e2d8db service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037332 Aug 24 06:47:19.791068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 369/763] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:20.418294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:20.418876 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:20.425778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.426182 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.426607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.427294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.427736 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.428147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.511562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:20.512904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:20.523867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.524353 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.524888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.528857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.529560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.530272 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.590697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:20.599582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e1e8c177-6deb-4d84-b744-b3f9424e467f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1729 microversion: 2.1 time: 0.185285 Aug 24 06:47:20.600512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 395/764] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:20 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:20.605863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:20.608069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:20.612780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.613292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.613932 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.614923 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.615376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.615797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.767030 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:20.775239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a110a164-340b-4cd7-89db-f525a4d63585 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.173609 Aug 24 06:47:20.776129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 396/765] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:20 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:20.781038 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b049ae9f-9b63-4f9a-8c5f-9e95e9bea380 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:20.781603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b049ae9f-9b63-4f9a-8c5f-9e95e9bea380 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:20.787408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b049ae9f-9b63-4f9a-8c5f-9e95e9bea380 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.787885 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b049ae9f-9b63-4f9a-8c5f-9e95e9bea380 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.788562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b049ae9f-9b63-4f9a-8c5f-9e95e9bea380 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.789571 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b049ae9f-9b63-4f9a-8c5f-9e95e9bea380 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.790246 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b049ae9f-9b63-4f9a-8c5f-9e95e9bea380 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.792024 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b049ae9f-9b63-4f9a-8c5f-9e95e9bea380 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.797509 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:20.874138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b049ae9f-9b63-4f9a-8c5f-9e95e9bea380 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096758 Aug 24 06:47:20.874946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 397/766] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 24 06:47:20 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:21.280127 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:21.290538 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-eecbe48e-433c-4512-ac9c-74794bcd31af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.786599 Aug 24 06:47:21.307043 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 370/767] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:20 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:21.329023 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-191822468", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4dc9d78-1179-43c9-875f-aca3db3dbf6c"}], "security_groups": [{"name": "tempest-securitygroup--587840390"}], "key_name": "tempest-keypair-1665440967", "user_data": "}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:21.544097 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:21.544097 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:21.557998 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:21.559857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:21.561327 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:21.562473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:21.563167 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:21.564363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:21.692073 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lazy-loading 'services' on Instance uuid 3ed98f99-0b60-4284-b252-931aa0e4adcc {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:47:21.700544 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] validate_networks() for [('f4dc9d78-1179-43c9-875f-aca3db3dbf6c', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:47:21.971638 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-25bbc665-f8eb-4671-ac5d-f42c09378007 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments/930e0b4f-0476-4029-8a24-feb274865e0e" status: 202 len: 0 microversion: 2.1 time: 0.433092 Aug 24 06:47:21.972219 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 371/768] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:47:21 2022] DELETE /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments/930e0b4f-0476-4029-8a24-feb274865e0e => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:47:21.977455 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:21.978189 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:21.984585 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:21.985500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:21.985861 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:21.986728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:21.987116 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:21.987717 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.138669 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:22.147546 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-aa483d9c-e747-4561-bf18-b9c9583db10c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.173967 Aug 24 06:47:22.148133 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 372/769] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:21 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:22.153520 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-04d23ca2-45ab-4d4c-9c70-806e164c64c6 req-f687bfcb-6175-440c-82c3-bfb939303d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed98f99-0b60-4284-b252-931aa0e4adcc", "tag": "4c9b237a-0d94-4b19-8954-bbc3140f2b84"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:22.163289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-04d23ca2-45ab-4d4c-9c70-806e164c64c6 req-f687bfcb-6175-440c-82c3-bfb939303d40 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.164133 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-04d23ca2-45ab-4d4c-9c70-806e164c64c6 req-f687bfcb-6175-440c-82c3-bfb939303d40 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.164779 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-04d23ca2-45ab-4d4c-9c70-806e164c64c6 req-f687bfcb-6175-440c-82c3-bfb939303d40 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.177125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-04d23ca2-45ab-4d4c-9c70-806e164c64c6 req-f687bfcb-6175-440c-82c3-bfb939303d40 service nova] Creating event network-changed:4c9b237a-0d94-4b19-8954-bbc3140f2b84 for instance 3ed98f99-0b60-4284-b252-931aa0e4adcc on hv-cinder-85427 Aug 24 06:47:22.183808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-04d23ca2-45ab-4d4c-9c70-806e164c64c6 req-f687bfcb-6175-440c-82c3-bfb939303d40 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034312 Aug 24 06:47:22.184615 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 373/770] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:22.190098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-73534f2e-a2cb-410f-b895-a28e80908f7b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:22.192548 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-73534f2e-a2cb-410f-b895-a28e80908f7b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:22.199541 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73534f2e-a2cb-410f-b895-a28e80908f7b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.200269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73534f2e-a2cb-410f-b895-a28e80908f7b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.219037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73534f2e-a2cb-410f-b895-a28e80908f7b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.219037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73534f2e-a2cb-410f-b895-a28e80908f7b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.219037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73534f2e-a2cb-410f-b895-a28e80908f7b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.219037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-73534f2e-a2cb-410f-b895-a28e80908f7b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.243295 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-73534f2e-a2cb-410f-b895-a28e80908f7b tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057267 Aug 24 06:47:22.244237 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 374/771] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:47:22 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:22.323960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:22.324575 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:22.338164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.338849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.339350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.340255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.340875 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.341500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.495016 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:47:22.495585 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:47:22.496405 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:47:22.496901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:47:22.497334 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:47:22.508421 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.509262 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.509942 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.510936 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.511761 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.512386 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.523011 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:22.534785 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f65b643d-9ab6-4ead-adc0-54f1faf3ae93 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.222365 Aug 24 06:47:22.549004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 375/772] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:22 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:22.553282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Getting quotas for project e1bf995c8c544dc29f42e53866cc6bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:47:22.560530 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Getting quotas for user 52f796d5013d4a31b107fb86c5523c9c and project e1bf995c8c544dc29f42e53866cc6bd2. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:47:22.574788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:47:22.579896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:47:22.623972 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-8d33764d-f2ee-4888-8bad-c0dfe3773d46 req-255a9907-6c07-4492-bcd5-d26de3460740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee546bf2-d24c-41cb-925a-b8c8ddd29697", "tag": "ffe40726-5b2e-4cbd-808c-978fb12b7e66"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:22.631141 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-8d33764d-f2ee-4888-8bad-c0dfe3773d46 req-255a9907-6c07-4492-bcd5-d26de3460740 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.631741 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-8d33764d-f2ee-4888-8bad-c0dfe3773d46 req-255a9907-6c07-4492-bcd5-d26de3460740 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.632484 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-8d33764d-f2ee-4888-8bad-c0dfe3773d46 req-255a9907-6c07-4492-bcd5-d26de3460740 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.645445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-8d33764d-f2ee-4888-8bad-c0dfe3773d46 req-255a9907-6c07-4492-bcd5-d26de3460740 service nova] Creating event network-changed:ffe40726-5b2e-4cbd-808c-978fb12b7e66 for instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 on hv-cinder-85427 Aug 24 06:47:22.652145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-8d33764d-f2ee-4888-8bad-c0dfe3773d46 req-255a9907-6c07-4492-bcd5-d26de3460740 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114515 Aug 24 06:47:22.655000 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 376/773] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:22.696042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [fc02bea2-4a08-4b6c-bcee-8d61d4a8f43d] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:47:23.172176 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:23.173150 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:23.182979 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:23.183543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:23.184000 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:23.185047 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:23.185532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:23.185953 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:23.351399 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:23.362212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4d60d7c3-5fe6-4472-9d4a-642223df089b tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.196547 Aug 24 06:47:23.363394 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 377/774] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:23 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:23.368400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-775a5b00-23ad-40d3-ae12-0c6b94778735 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:23.371341 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-775a5b00-23ad-40d3-ae12-0c6b94778735 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:23.383320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-775a5b00-23ad-40d3-ae12-0c6b94778735 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:23.383810 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-775a5b00-23ad-40d3-ae12-0c6b94778735 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:23.384246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-775a5b00-23ad-40d3-ae12-0c6b94778735 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:23.385016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-775a5b00-23ad-40d3-ae12-0c6b94778735 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:23.385596 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-775a5b00-23ad-40d3-ae12-0c6b94778735 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:23.386313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-775a5b00-23ad-40d3-ae12-0c6b94778735 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:23.420803 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-775a5b00-23ad-40d3-ae12-0c6b94778735 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056085 Aug 24 06:47:23.421426 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 378/775] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:47:23 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:23.556407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:23.557308 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:23.563863 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:23.564343 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:23.564779 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:23.565506 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:23.565965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:23.566383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:23.708088 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO oslo.messaging._drivers.impl_rabbit [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [fc02bea2-4a08-4b6c-bcee-8d61d4a8f43d] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54834. Aug 24 06:47:23.714025 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-23339d82-077c-4fb1-91bf-67fd24eac895 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.389615 Aug 24 06:47:23.715379 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 398/776] 10.222.0.47 () {62 vars in 1188 bytes} [Wed Aug 24 06:47:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 06:47:23.716310 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:23.725981 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2db9bcad-dc12-4b8d-9cf4-9aa3f588291f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.173338 Aug 24 06:47:23.737224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 379/777] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:23 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:23.744747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-873e0120-64b5-4f5b-88e5-8103147ea7e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:23.745721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-873e0120-64b5-4f5b-88e5-8103147ea7e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:23.815693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-873e0120-64b5-4f5b-88e5-8103147ea7e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:23.827595 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-873e0120-64b5-4f5b-88e5-8103147ea7e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:23.830136 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-873e0120-64b5-4f5b-88e5-8103147ea7e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:23.831497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-873e0120-64b5-4f5b-88e5-8103147ea7e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1281 microversion: 2.20 time: 0.092401 Aug 24 06:47:23.832285 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 399/778] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:23 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:24.382605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:24.383226 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:24.390154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:24.390900 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:24.391560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:24.392264 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:24.392887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:24.393343 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:24.433098 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3a600045-caa0-445c-8f98-1a91d6ca1fa8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:24.435373 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3a600045-caa0-445c-8f98-1a91d6ca1fa8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:24.442447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3a600045-caa0-445c-8f98-1a91d6ca1fa8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:24.442947 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3a600045-caa0-445c-8f98-1a91d6ca1fa8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:24.443568 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3a600045-caa0-445c-8f98-1a91d6ca1fa8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:24.444273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3a600045-caa0-445c-8f98-1a91d6ca1fa8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:24.444872 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3a600045-caa0-445c-8f98-1a91d6ca1fa8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:24.445514 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3a600045-caa0-445c-8f98-1a91d6ca1fa8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:24.481669 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3a600045-caa0-445c-8f98-1a91d6ca1fa8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053074 Aug 24 06:47:24.482508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 400/779] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:47:24 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:24.674126 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-32e03939-4862-41d2-832f-0f44c7415ec4 req-90814d29-841d-47cc-930f-5d59daf106aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee546bf2-d24c-41cb-925a-b8c8ddd29697", "tag": "ffe40726-5b2e-4cbd-808c-978fb12b7e66"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:24.686120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-32e03939-4862-41d2-832f-0f44c7415ec4 req-90814d29-841d-47cc-930f-5d59daf106aa service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:24.686871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-32e03939-4862-41d2-832f-0f44c7415ec4 req-90814d29-841d-47cc-930f-5d59daf106aa service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:24.687461 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-32e03939-4862-41d2-832f-0f44c7415ec4 req-90814d29-841d-47cc-930f-5d59daf106aa service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:24.700892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-32e03939-4862-41d2-832f-0f44c7415ec4 req-90814d29-841d-47cc-930f-5d59daf106aa service nova] Creating event network-changed:ffe40726-5b2e-4cbd-808c-978fb12b7e66 for instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 on hv-cinder-85427 Aug 24 06:47:24.706493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-32e03939-4862-41d2-832f-0f44c7415ec4 req-90814d29-841d-47cc-930f-5d59daf106aa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036784 Aug 24 06:47:24.710101 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 401/780] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:24.756034 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:24.757161 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:24.764620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:24.765117 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:24.765581 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:24.766283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:24.766732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:24.767153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:24.822226 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:24.832838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7658811f-87d4-4e47-9296-4fd642fd456f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.454123 Aug 24 06:47:24.847956 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 380/781] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:24 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:24.864969 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:24.871352 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:24.883094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:24.884442 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:24.886814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:24.888016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:24.888769 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:24.889451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:24.984153 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:24.984463 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:24.997010 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ad18a62d-a8c5-4146-878b-9289342d9596 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.247177 Aug 24 06:47:25.002394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 402/782] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:24 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:25.013796 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:25.017466 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:25.018937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2ddc79f3-4a59-44fc-9794-96f30c5dcf62 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1285 microversion: 2.20 time: 0.165595 Aug 24 06:47:25.021557 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 381/783] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:24 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:25.495893 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b7a9b464-a519-43e8-ac21-305c247a3eb8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:25.498128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b7a9b464-a519-43e8-ac21-305c247a3eb8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:25.504767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7a9b464-a519-43e8-ac21-305c247a3eb8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:25.505273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7a9b464-a519-43e8-ac21-305c247a3eb8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:25.505704 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7a9b464-a519-43e8-ac21-305c247a3eb8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:25.506446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7a9b464-a519-43e8-ac21-305c247a3eb8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:25.506880 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7a9b464-a519-43e8-ac21-305c247a3eb8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:25.507468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7a9b464-a519-43e8-ac21-305c247a3eb8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:25.539819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b7a9b464-a519-43e8-ac21-305c247a3eb8 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048583 Aug 24 06:47:25.541143 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 403/784] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:47:25 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:47:25.553342 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:25.553829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:25.560130 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:25.560609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:25.561041 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:25.561754 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:25.562386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:25.562818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:25.570203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:25.645413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] HTTP exception thrown: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc is not attached to volume 930e0b4f-0476-4029-8a24-feb274865e0e Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Request method failure captured: Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments/930e0b4f-0476-4029-8a24-feb274865e0e HTTP/1.1 Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBch1YCx7J4fd8k4GoiSiqTn1eRGbMI9truzq6D2WvYl2ZW-sCufRzcL6_k1ht8EmrffAU3f_VOSAcyImdJVE6mNmPHa_R8L8_wFpCyOG0vlufUGYIpTdDX8_TiY_h3_bULD4XCnbpYZ80UOkBLDd0sO173gXE8mTwKtUHFanBshXAZg Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: e36bdfb532924d8ebe001112e285fcdc Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-TestMinimumBasicScenario-35859005 Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:47:25.653490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e36bdfb532924d8ebe001112e285fcdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e36bdfb532924d8ebe001112e285fcdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e36bdfb532924d8ebe001112e285fcdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e36bdfb532924d8ebe001112e285fcdc", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-TestMinimumBasicScenario-35859005 Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: e36bdfb532924d8ebe001112e285fcdc Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-TestMinimumBasicScenario-35859005 Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-TestMinimumBasicScenario-35859005-project Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: fc1fefc915e941628a01336564368f81 Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-TestMinimumBasicScenario-35859005-project Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:47:25.655151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc is not attached to volume 930e0b4f-0476-4029-8a24-feb274865e0e Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'server_id': '3ed98f99-0b60-4284-b252-931aa0e4adcc', 'id': '930e0b4f-0476-4029-8a24-feb274865e0e'} Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 930e0b4f-0476-4029-8a24-feb274865e0e. Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:25.655906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc is not attached to volume 930e0b4f-0476-4029-8a24-feb274865e0e Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc is not attached to volume 930e0b4f-0476-4029-8a24-feb274865e0e Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:25.657396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Returning 404 to user: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc is not attached to volume 930e0b4f-0476-4029-8a24-feb274865e0e {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:25.658523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-58e867d7-5260-4354-8814-8c7db54f0c25 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments/930e0b4f-0476-4029-8a24-feb274865e0e" status: 404 len: 154 microversion: 2.1 time: 0.105976 Aug 24 06:47:25.658523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 382/785] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:47:25 2022] DELETE /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc/os-volume_attachments/930e0b4f-0476-4029-8a24-feb274865e0e => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:47:25.858102 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:25.859223 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:25.867930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:25.868428 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:25.868857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:25.869960 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:25.870535 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:25.870876 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:26.035913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:26.037458 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:26.044311 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:26.044813 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:26.045304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:26.046055 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:26.046544 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:26.046970 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:26.053784 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:26.064656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-49920783-0b07-4107-9b67-df5d3d61b33f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.212252 Aug 24 06:47:26.065689 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 404/786] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:25 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:26.072813 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:26.073745 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:26.095911 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:26.096810 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:26.097439 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:26.098172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:26.098637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:26.099021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:26.169780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:26.178613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:26.180532 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:26.181966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f114f20c-c34a-46a0-9fdc-08c5a2f3991b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1341 microversion: 2.20 time: 0.114948 Aug 24 06:47:26.182747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 405/787] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:26 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1341 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:26.587546 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:26.602544 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fed1ff16-c009-418f-b53a-e887ad3a6969 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.570872 Aug 24 06:47:26.603317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 383/788] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:26 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:26.603443 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-8d64fdc4-9855-45bd-b83d-f7991178f198 req-c8ba0027-e37c-4c0a-bcf1-a924a803a86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086395fc-028c-495d-993a-8fee70809181", "name": "network-vif-plugged", "status": "completed", "tag": "3a5db911-d33c-4154-8327-fcf2006fa1a4"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:26.613240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-8d64fdc4-9855-45bd-b83d-f7991178f198 req-c8ba0027-e37c-4c0a-bcf1-a924a803a86e service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:26.613646 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-8d64fdc4-9855-45bd-b83d-f7991178f198 req-c8ba0027-e37c-4c0a-bcf1-a924a803a86e service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:26.614064 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-8d64fdc4-9855-45bd-b83d-f7991178f198 req-c8ba0027-e37c-4c0a-bcf1-a924a803a86e service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:26.626917 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-8d64fdc4-9855-45bd-b83d-f7991178f198 req-c8ba0027-e37c-4c0a-bcf1-a924a803a86e service nova] Creating event network-vif-plugged:3a5db911-d33c-4154-8327-fcf2006fa1a4 for instance 086395fc-028c-495d-993a-8fee70809181 on hv-cinder-85427 Aug 24 06:47:26.631940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-8d64fdc4-9855-45bd-b83d-f7991178f198 req-c8ba0027-e37c-4c0a-bcf1-a924a803a86e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115264 Aug 24 06:47:26.632529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 406/789] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:27.063847 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:27.064657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:27.072064 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.072608 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.073115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.073911 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.074421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.074850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.089649 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:27.090419 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:27.096820 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.097330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.097765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.098459 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.098907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.099327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.100821 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:47:27.241874 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:27.250361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a67ee45b-de80-43d9-b3dc-38f26ef74948 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.165792 Aug 24 06:47:27.250944 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 407/790] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:27 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:27.255565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:27.256164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:27.262015 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.262496 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.262927 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.263612 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.264059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.264494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.328007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:27.336249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:27.338706 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:27.339586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-538ced1e-1f4d-4e52-915c-3b28f1913b6d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1339 microversion: 2.20 time: 0.087513 Aug 24 06:47:27.340154 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 408/791] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:27 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:27.393054 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-535f22bc-ae3c-4da9-a3e0-678848d3bf62 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 204 len: 0 microversion: 2.1 time: 0.335930 Aug 24 06:47:27.393792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 384/792] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:47:27 2022] DELETE /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:47:27.403199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:27.403808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:27.410229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.410721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.411779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.411978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.412343 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.412756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.551892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:27.560902 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-18ae06d6-bdc6-4663-a85b-5b66e30f9961 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1554 microversion: 2.1 time: 0.162698 Aug 24 06:47:27.561534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 409/793] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:27 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:27.624002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:27.624694 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:27.631598 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.632166 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.632593 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.633311 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:27.633762 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:27.634175 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:27.862534 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:27.871449 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2674b99d-4108-410f-b7b6-e02fe289d859 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.251792 Aug 24 06:47:27.872105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 385/794] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:27 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:28.272785 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:28.276176 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:28.284212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.288045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.288045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:28.288045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.288045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.288622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:28.363393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:28.363998 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:28.372594 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.373085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.382002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:28.382002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.382002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.382002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:28.484013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:28.494818 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-da899f66-3fd7-4e88-9d9a-163ab230fddf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.227188 Aug 24 06:47:28.495437 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 410/795] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:28 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:28.582742 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:28.583341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:28.591388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.591876 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.592292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:28.592986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.593447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.593859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:28.750529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:28.757201 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:28.765903 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-869a0eee-9ad0-4fa9-9a8a-0e990940913e tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1554 microversion: 2.1 time: 0.186941 Aug 24 06:47:28.766456 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 411/796] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:28 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:28.771664 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:28.773148 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:28.774392 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1ab44178-f496-481b-9b9f-a8f2722697dd tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.414809 Aug 24 06:47:28.784259 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 386/797] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:28 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:28.892326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:28.893055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:28.899446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.900073 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.900979 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:28.906004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.906004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.906004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.038125 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:29.046726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-704cd457-0755-47a0-b59e-824e8ef369af tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.158318 Aug 24 06:47:29.047294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 412/798] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:28 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:29.516000 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:29.516731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:29.522750 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.523260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.523689 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.524380 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.524831 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.525277 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.794556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:29.795326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:29.802044 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.802619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.804085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.804085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.804273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.805073 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.819879 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:29.828380 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-314bbcb8-5d23-4e36-9c8f-b7cbca52ceba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.316164 Aug 24 06:47:29.829323 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 387/799] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:29 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:29.833999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:29.834787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:29.845692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.847194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.847636 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.848632 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.849442 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.849935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.942590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:29.950998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7b4b5b8b-6b74-437e-a10a-72d2e85b1e1a tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1554 microversion: 2.1 time: 0.160708 Aug 24 06:47:29.951590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 413/800] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:29 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:30.028554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:30.036693 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:30.038220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:30.039322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2b1d3603-da41-4972-a136-01cd448e0544 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.208915 Aug 24 06:47:30.039872 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 388/801] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:29 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:30.068104 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:30.068714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:30.074745 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.075229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.075669 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:30.076473 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.076917 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.077372 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:30.216892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:30.224999 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6994405d-cdf3-434b-b253-43d19c3e334a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.160803 Aug 24 06:47:30.225695 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 414/802] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:30 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:30.370244 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-fd1e4386-bfec-4691-97ab-34a74ab2bf5e req-96e67884-96af-4265-9f28-6344a57be634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391581a7-43ed-48fd-add7-cbc73108eae4", "tag": "0621de02-3d16-4e02-ac8f-b0ed8b589e93"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:30.379650 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-fd1e4386-bfec-4691-97ab-34a74ab2bf5e req-96e67884-96af-4265-9f28-6344a57be634 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.380140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-fd1e4386-bfec-4691-97ab-34a74ab2bf5e req-96e67884-96af-4265-9f28-6344a57be634 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.380568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-fd1e4386-bfec-4691-97ab-34a74ab2bf5e req-96e67884-96af-4265-9f28-6344a57be634 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:30.391952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-fd1e4386-bfec-4691-97ab-34a74ab2bf5e req-96e67884-96af-4265-9f28-6344a57be634 service nova] Creating event network-changed:0621de02-3d16-4e02-ac8f-b0ed8b589e93 for instance 391581a7-43ed-48fd-add7-cbc73108eae4 on hv-cinder-85427 Aug 24 06:47:30.397202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-fd1e4386-bfec-4691-97ab-34a74ab2bf5e req-96e67884-96af-4265-9f28-6344a57be634 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030539 Aug 24 06:47:30.397816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 389/803] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:30.667227 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-8a182897-74b0-4879-a582-638c2acf6a88 req-3bd2fd2c-acb6-4593-b0a9-e8f5f361f760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e19365c-8664-4f9a-bd20-ff53faa8f495", "name": "network-vif-plugged", "status": "completed", "tag": "83213354-63ee-4dfa-bbb7-7105246d4dc8"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:30.677690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-8a182897-74b0-4879-a582-638c2acf6a88 req-3bd2fd2c-acb6-4593-b0a9-e8f5f361f760 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.678160 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-8a182897-74b0-4879-a582-638c2acf6a88 req-3bd2fd2c-acb6-4593-b0a9-e8f5f361f760 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.678576 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-8a182897-74b0-4879-a582-638c2acf6a88 req-3bd2fd2c-acb6-4593-b0a9-e8f5f361f760 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:30.690270 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-8a182897-74b0-4879-a582-638c2acf6a88 req-3bd2fd2c-acb6-4593-b0a9-e8f5f361f760 service nova] Creating event network-vif-plugged:83213354-63ee-4dfa-bbb7-7105246d4dc8 for instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 on hv-cinder-85427 Aug 24 06:47:30.695116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-8a182897-74b0-4879-a582-638c2acf6a88 req-3bd2fd2c-acb6-4593-b0a9-e8f5f361f760 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031756 Aug 24 06:47:30.698038 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 415/804] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:30.850580 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:30.851258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:30.858306 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.858852 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.859386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:30.860113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.860568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.860992 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:30.973653 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:30.974526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:30.981101 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.981871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.982299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:30.982987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.983587 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.984007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:31.125960 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:31.136394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ca5f1d66-e529-4a2d-a39e-21eb24f1efc4 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1554 microversion: 2.1 time: 0.167888 Aug 24 06:47:31.136945 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 416/805] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:30 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:31.141955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:31.142563 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:31.154220 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:31.154853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:31.158851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:31.158851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:31.158851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:31.158851 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:31.198722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:31.210445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1b0635aa-b995-4b68-809c-a7a56bffe832 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.364208 Aug 24 06:47:31.211024 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 390/806] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:30 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:31.253819 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:31.254716 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:31.261801 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:31.262592 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:31.263286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:31.264005 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:31.264635 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:31.265410 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:31.321873 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:31.326496 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:31.331883 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:31.333423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:31.334537 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-50a296b9-bfd0-4e4c-b3ff-b449d02b3c9e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.196648 Aug 24 06:47:31.335150 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 417/807] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:31 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:31.484016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:31.492394 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-26c059b8-0a92-4412-a4ee-48194eace15f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1366 microversion: 2.1 time: 0.242194 Aug 24 06:47:31.505210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 391/808] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:31 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:32.158610 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:32.159247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:32.166820 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.168460 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.168460 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.169364 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.169364 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.169874 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.232588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:32.233282 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:32.233902 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:32.240472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.241853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.242289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.242406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6ce27167-0af0-4543-82ac-cb7084e01ddb tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1343 microversion: 2.1 time: 0.088158 Aug 24 06:47:32.255752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.255978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 418/809] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:32 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1343 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:32.256080 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.256080 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.358380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:32.359343 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:32.365982 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.366486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.366927 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.367796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.368493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.369000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.500222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:32.508173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ae971653-1f5d-4016-aeea-931e4deced7e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.279974 Aug 24 06:47:32.508759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 392/810] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:32 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:32.514275 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-90cf1eed-0b28-422e-aa16-b6d29e2ef480 req-91ca4e95-930e-4cf0-a017-f366d8b4d75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed98f99-0b60-4284-b252-931aa0e4adcc", "name": "network-vif-deleted", "tag": "4c9b237a-0d94-4b19-8954-bbc3140f2b84"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:32.524192 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-90cf1eed-0b28-422e-aa16-b6d29e2ef480 req-91ca4e95-930e-4cf0-a017-f366d8b4d75f service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.524960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-90cf1eed-0b28-422e-aa16-b6d29e2ef480 req-91ca4e95-930e-4cf0-a017-f366d8b4d75f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.525762 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-90cf1eed-0b28-422e-aa16-b6d29e2ef480 req-91ca4e95-930e-4cf0-a017-f366d8b4d75f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.527671 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:32.531984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:32.537971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-90cf1eed-0b28-422e-aa16-b6d29e2ef480 req-91ca4e95-930e-4cf0-a017-f366d8b4d75f service nova] Creating event network-vif-deleted:4c9b237a-0d94-4b19-8954-bbc3140f2b84 for instance 3ed98f99-0b60-4284-b252-931aa0e4adcc on hv-cinder-85427 Aug 24 06:47:32.541353 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:32.543159 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-90cf1eed-0b28-422e-aa16-b6d29e2ef480 req-91ca4e95-930e-4cf0-a017-f366d8b4d75f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033227 Aug 24 06:47:32.543302 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:32.543749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 393/811] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:32.544326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5de5aad7-5bdf-4f98-bbd2-9dbcce16384d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.190782 Aug 24 06:47:32.548914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 419/812] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:32 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:32.551176 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:32.551869 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:32.558993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.559476 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.559988 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.560599 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.561051 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.561611 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.705576 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:32.714140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-54e24d88-d8d1-4a63-9646-9d59ab53441c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1556 microversion: 2.1 time: 0.167272 Aug 24 06:47:32.714707 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 394/813] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:32 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:32.735127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-03966025-daf1-4485-ad76-07e8d49d07e3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:32.735613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-03966025-daf1-4485-ad76-07e8d49d07e3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:32.742045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-03966025-daf1-4485-ad76-07e8d49d07e3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.742528 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-03966025-daf1-4485-ad76-07e8d49d07e3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.743050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-03966025-daf1-4485-ad76-07e8d49d07e3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.743652 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-03966025-daf1-4485-ad76-07e8d49d07e3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.744100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-03966025-daf1-4485-ad76-07e8d49d07e3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.744515 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-03966025-daf1-4485-ad76-07e8d49d07e3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.825992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-03966025-daf1-4485-ad76-07e8d49d07e3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094680 Aug 24 06:47:32.826588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 420/814] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 24 06:47:32 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:33.264899 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:33.265326 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:33.272323 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.272809 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.273268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.281325 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.281325 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.281325 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.315025 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.315513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.315948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.322012 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lazy-loading 'fault' on Instance uuid 3ed98f99-0b60-4284-b252-931aa0e4adcc {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:47:33.531660 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:33.532332 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:33.539044 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.539856 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.540492 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.541760 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.542325 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.542751 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.632831 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc1fefc915e941628a01336564368f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36bdfb532924d8ebe001112e285fcdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:33.649939 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bea8dba0-d5d1-4571-8748-4e3e7ce0f9cc tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 200 len: 1348 microversion: 2.1 time: 0.390143 Aug 24 06:47:33.650753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 395/815] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:33 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 1348 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:33.656962 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:33.657893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:33.671501 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.672170 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.672970 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.673838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.674400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.674977 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.798570 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:33.812577 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-db7d9e74-40fd-42be-b960-fc827c5b0487 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1267 microversion: 2.1 time: 0.285204 Aug 24 06:47:33.814877 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 421/816] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:33 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:33.881136 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:33.892438 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:33.894159 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:33.895312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-27531587-0264-4344-8a1c-272047274514 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.243077 Aug 24 06:47:33.896086 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 396/817] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:33 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:34.001484 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-19284b3e-48a0-4921-9d2a-d9904c717741 req-e74d3f25-ce35-474e-8bb6-ef2916eac686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086395fc-028c-495d-993a-8fee70809181", "tag": "3a5db911-d33c-4154-8327-fcf2006fa1a4"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:34.006717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=20 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:34.012242 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-19284b3e-48a0-4921-9d2a-d9904c717741 req-e74d3f25-ce35-474e-8bb6-ef2916eac686 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.012795 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-19284b3e-48a0-4921-9d2a-d9904c717741 req-e74d3f25-ce35-474e-8bb6-ef2916eac686 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.013246 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-19284b3e-48a0-4921-9d2a-d9904c717741 req-e74d3f25-ce35-474e-8bb6-ef2916eac686 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.026402 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-19284b3e-48a0-4921-9d2a-d9904c717741 req-e74d3f25-ce35-474e-8bb6-ef2916eac686 service nova] Creating event network-changed:3a5db911-d33c-4154-8327-fcf2006fa1a4 for instance 086395fc-028c-495d-993a-8fee70809181 on hv-cinder-85427 Aug 24 06:47:34.031250 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-19284b3e-48a0-4921-9d2a-d9904c717741 req-e74d3f25-ce35-474e-8bb6-ef2916eac686 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033459 Aug 24 06:47:34.032127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 422/818] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:34.675853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:34.677815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] [instance: 3ed98f99-0b60-4284-b252-931aa0e4adcc] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:34.685140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.685643 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.686084 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.686828 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.687278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.687691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.703578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] HTTP exception thrown: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc could not be found. Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Request method failure captured: Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc HTTP/1.1 Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBch1YCx7J4fd8k4GoiSiqTn1eRGbMI9truzq6D2WvYl2ZW-sCufRzcL6_k1ht8EmrffAU3f_VOSAcyImdJVE6mNmPHa_R8L8_wFpCyOG0vlufUGYIpTdDX8_TiY_h3_bULD4XCnbpYZ80UOkBLDd0sO173gXE8mTwKtUHFanBshXAZg Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: e36bdfb532924d8ebe001112e285fcdc Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-TestMinimumBasicScenario-35859005 Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:47:34.705266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e36bdfb532924d8ebe001112e285fcdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e36bdfb532924d8ebe001112e285fcdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e36bdfb532924d8ebe001112e285fcdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e36bdfb532924d8ebe001112e285fcdc", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-TestMinimumBasicScenario-35859005 Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: e36bdfb532924d8ebe001112e285fcdc Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-TestMinimumBasicScenario-35859005 Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-TestMinimumBasicScenario-35859005-project Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: fc1fefc915e941628a01336564368f81 Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-TestMinimumBasicScenario-35859005-project Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc could not be found. Aug 24 06:47:34.706589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '3ed98f99-0b60-4284-b252-931aa0e4adcc'} Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc could not be found. Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:34.707286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc could not be found. Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc could not be found. Aug 24 06:47:34.709304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:47:34.711180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Returning 404 to user: Instance 3ed98f99-0b60-4284-b252-931aa0e4adcc could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:34.711180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c8fd5e82-8c64-417b-b0ac-ffa37de0b0d5 tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc" status: 404 len: 111 microversion: 2.1 time: 0.036092 Aug 24 06:47:34.711180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 397/819] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:34 2022] GET /compute/v2.1/servers/3ed98f99-0b60-4284-b252-931aa0e4adcc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:47:34.716964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3be2c8e1-cd5b-477c-ad5f-2db9dbfbba8f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] Calling method '.version_select at 0x7fb5d8da1af0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:34.789372 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3be2c8e1-cd5b-477c-ad5f-2db9dbfbba8f tempest-TestMinimumBasicScenario-35859005 tempest-TestMinimumBasicScenario-35859005-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1126781627" status: 202 len: 0 microversion: 2.1 time: 0.077117 Aug 24 06:47:34.789964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 423/820] 10.222.0.47 () {58 vars in 1272 bytes} [Wed Aug 24 06:47:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1126781627 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:47:34.835497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:34.836110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:34.842324 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.843039 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.843754 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.844517 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.844965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.845502 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.919323 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:34.920306 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:34.928997 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.929546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.929975 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.930673 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.931112 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.931981 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.994113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:34.998084 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:35.003947 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3dffa949-1277-483e-a853-7a06fe7366bf tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1454 microversion: 2.1 time: 0.172502 Aug 24 06:47:35.004846 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 398/821] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:34 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1454 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:35.030090 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:35.030896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:35.038258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:35.038825 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:35.039340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:35.040114 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:35.040667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:35.041378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:35.086991 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:35.096455 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:35.098012 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:35.099106 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-78f697f3-5cb1-411e-856b-156c322b452e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.184826 Aug 24 06:47:35.099652 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 424/822] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:34 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:35.197338 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:35.205536 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a7f3304c-329a-4058-8d40-281492a11fa8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1454 microversion: 2.1 time: 0.180493 Aug 24 06:47:35.206103 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 399/823] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:35 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:36.124451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:36.125138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:36.132293 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.132769 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.133743 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.134671 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.135320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.135724 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.381965 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:36.391852 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:36.393687 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:36.394922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9b5c00c7-e897-46aa-9290-b68ac7bfee67 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.274747 Aug 24 06:47:36.395648 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 425/824] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:36 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:37.420081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:37.420752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:37.428094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:37.428927 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:37.429464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:37.430231 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:37.430907 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:37.431414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:37.631287 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:37.640087 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:37.641907 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:37.643078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-913bc499-9960-40a1-9817-03195139d6e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.228099 Aug 24 06:47:37.643759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 400/825] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:37 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:37.811078 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-78a307a3-706f-486e-8508-76520b69d82c req-074c54eb-6bb8-4cfa-8239-5e72bd219a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e19365c-8664-4f9a-bd20-ff53faa8f495", "tag": "83213354-63ee-4dfa-bbb7-7105246d4dc8"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:37.822388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-78a307a3-706f-486e-8508-76520b69d82c req-074c54eb-6bb8-4cfa-8239-5e72bd219a81 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:37.823178 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-78a307a3-706f-486e-8508-76520b69d82c req-074c54eb-6bb8-4cfa-8239-5e72bd219a81 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:37.823603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-78a307a3-706f-486e-8508-76520b69d82c req-074c54eb-6bb8-4cfa-8239-5e72bd219a81 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:37.839351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-78a307a3-706f-486e-8508-76520b69d82c req-074c54eb-6bb8-4cfa-8239-5e72bd219a81 service nova] Creating event network-changed:83213354-63ee-4dfa-bbb7-7105246d4dc8 for instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 on hv-cinder-85427 Aug 24 06:47:37.846709 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-78a307a3-706f-486e-8508-76520b69d82c req-074c54eb-6bb8-4cfa-8239-5e72bd219a81 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041780 Aug 24 06:47:37.849366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 426/826] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:38.666972 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:38.667588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:38.674742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:38.685547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:38.686243 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:38.687162 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:38.687785 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:38.688397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:38.952581 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:38.964318 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:38.968331 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:38.975672 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-422271db-42ef-4799-88d5-e890bd875bc6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.311881 Aug 24 06:47:38.976680 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 401/827] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:38 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:40.002837 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:40.003725 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:40.012043 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:40.013061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:40.013523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:40.014488 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:40.015041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:40.015868 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:40.243471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:40.252828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:40.254415 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:40.255532 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f9fbaa01-4018-47a2-b520-20d7604bebf5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.257201 Aug 24 06:47:40.256106 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 427/828] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:39 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:41.046266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-9e370363-3d67-4c73-afd3-5dfca7df4898 req-7faa32cd-05c8-4019-8190-7da73775023a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391581a7-43ed-48fd-add7-cbc73108eae4", "name": "network-vif-plugged", "status": "completed", "tag": "0621de02-3d16-4e02-ac8f-b0ed8b589e93"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:41.062740 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-9e370363-3d67-4c73-afd3-5dfca7df4898 req-7faa32cd-05c8-4019-8190-7da73775023a service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.063299 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-9e370363-3d67-4c73-afd3-5dfca7df4898 req-7faa32cd-05c8-4019-8190-7da73775023a service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.063962 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-9e370363-3d67-4c73-afd3-5dfca7df4898 req-7faa32cd-05c8-4019-8190-7da73775023a service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.079070 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-9e370363-3d67-4c73-afd3-5dfca7df4898 req-7faa32cd-05c8-4019-8190-7da73775023a service nova] Creating event network-vif-plugged:0621de02-3d16-4e02-ac8f-b0ed8b589e93 for instance 391581a7-43ed-48fd-add7-cbc73108eae4 on hv-cinder-85427 Aug 24 06:47:41.084146 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-9e370363-3d67-4c73-afd3-5dfca7df4898 req-7faa32cd-05c8-4019-8190-7da73775023a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043616 Aug 24 06:47:41.084839 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 402/829] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:41.279316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:41.279982 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:41.283746 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:41.288476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.289139 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.289937 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.290649 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.291707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.292308 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.455407 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:41.463985 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:41.465579 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:41.466714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9924ee30-d53f-4ec2-9a83-909d6b311455 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.192502 Aug 24 06:47:41.467374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 428/830] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:41 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:42.490560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:42.491413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:42.498179 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:42.498680 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:42.499115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:42.500564 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:42.500564 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:42.500564 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:42.649353 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:42.655880 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:42.663872 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:42.663872 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-dd621179-e0cf-467d-817e-f4d1be6a5a0f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1406 microversion: 2.20 time: 0.173427 Aug 24 06:47:42.663872 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 403/831] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:42 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:43.684845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:43.685922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:43.693268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.693757 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.694192 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.695084 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.695531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.696118 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.898656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:43.907555 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:43.909231 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:43.910703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b0aed5b9-bb00-49af-838e-4b6b6bcf6bb5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1598 microversion: 2.20 time: 0.233452 Aug 24 06:47:43.911611 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 429/832] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:43 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1598 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:43.937359 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-de58cd66-7999-46c1-9245-77b5c1aaa5fc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:43.943513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-de58cd66-7999-46c1-9245-77b5c1aaa5fc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:43.946644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de58cd66-7999-46c1-9245-77b5c1aaa5fc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.948070 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de58cd66-7999-46c1-9245-77b5c1aaa5fc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.949003 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de58cd66-7999-46c1-9245-77b5c1aaa5fc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.950077 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de58cd66-7999-46c1-9245-77b5c1aaa5fc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.950559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de58cd66-7999-46c1-9245-77b5c1aaa5fc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.950987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de58cd66-7999-46c1-9245-77b5c1aaa5fc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:44.044381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-de58cd66-7999-46c1-9245-77b5c1aaa5fc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.110606 Aug 24 06:47:44.044381 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 404/833] 10.222.0.47 () {60 vars in 1316 bytes} [Wed Aug 24 06:47:43 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:47:45.869822 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-ac63bb46-ff5d-4efa-be5c-27226fd1ecb1 req-c3ae6b8b-f2d3-4846-8f41-699530d8baae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391581a7-43ed-48fd-add7-cbc73108eae4", "tag": "0621de02-3d16-4e02-ac8f-b0ed8b589e93"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:45.886212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-ac63bb46-ff5d-4efa-be5c-27226fd1ecb1 req-c3ae6b8b-f2d3-4846-8f41-699530d8baae service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.887030 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-ac63bb46-ff5d-4efa-be5c-27226fd1ecb1 req-c3ae6b8b-f2d3-4846-8f41-699530d8baae service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.887792 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-ac63bb46-ff5d-4efa-be5c-27226fd1ecb1 req-c3ae6b8b-f2d3-4846-8f41-699530d8baae service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.902048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-ac63bb46-ff5d-4efa-be5c-27226fd1ecb1 req-c3ae6b8b-f2d3-4846-8f41-699530d8baae service nova] Creating event network-changed:0621de02-3d16-4e02-ac8f-b0ed8b589e93 for instance 391581a7-43ed-48fd-add7-cbc73108eae4 on hv-cinder-85427 Aug 24 06:47:45.907667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-ac63bb46-ff5d-4efa-be5c-27226fd1ecb1 req-c3ae6b8b-f2d3-4846-8f41-699530d8baae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045519 Aug 24 06:47:45.912800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 430/834] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:56.395445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:56.396190 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=30 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:56.400155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b7bd6098-a929-4285-99d0-008215c0e482 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:56.403363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b7bd6098-a929-4285-99d0-008215c0e482 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:56.409272 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7bd6098-a929-4285-99d0-008215c0e482 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:56.409758 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7bd6098-a929-4285-99d0-008215c0e482 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:56.410193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7bd6098-a929-4285-99d0-008215c0e482 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:56.410883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7bd6098-a929-4285-99d0-008215c0e482 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:56.411340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7bd6098-a929-4285-99d0-008215c0e482 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:56.411760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b7bd6098-a929-4285-99d0-008215c0e482 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:56.442285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b7bd6098-a929-4285-99d0-008215c0e482 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048314 Aug 24 06:47:56.442816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 405/835] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:47:56 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:47:56.508268 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:56.508843 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:56.511503 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=5 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:56.512148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=58 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:56.516940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:56.517449 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:56.517877 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:56.518557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:56.518998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:56.519541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:56.546227 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:47:56.861089 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7c2a109f-5e7a-4cc8-ab9c-e802cee3338c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "DELETE /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 204 len: 0 microversion: 2.1 time: 0.356736 Aug 24 06:47:56.861731 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 431/836] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:47:56 2022] DELETE /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:47:56.874929 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:56.875667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:56.887370 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:56.897850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:56.897850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:56.897850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:56.897850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:56.898269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:57.030494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:57.038528 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d1418083-13e9-48f4-9f77-484db8e436bb tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1675 microversion: 2.1 time: 0.172094 Aug 24 06:47:57.039080 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 406/837] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:56 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:58.061677 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:58.062364 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:58.070080 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:58.070736 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:58.071163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:58.071859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:58.072301 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:58.072716 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:58.210930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:58.219172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c018f31b-b877-4ea6-8be6-c007d61a5634 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1675 microversion: 2.1 time: 0.162859 Aug 24 06:47:58.219749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 432/838] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:58 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:59.241529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:59.242306 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:59.250038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:59.250524 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:59.250995 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:59.251690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:59.252136 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:59.252555 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:59.324219 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:59.332786 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c3f3213e-7ca4-44de-ad50-879ffd51ecc3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1608 microversion: 2.1 time: 0.095631 Aug 24 06:47:59.333408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 407/839] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:59 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1608 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:59.517553 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-64ed12ca-6e64-48df-9747-3da765f685af req-84f40512-fe41-41c0-b2d2-72aed791bb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821b76aa-235d-42ca-aec6-6597a19525c0", "name": "network-vif-deleted", "tag": "093eee48-f69e-45f9-8131-16d82edc3341"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:59.533490 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-64ed12ca-6e64-48df-9747-3da765f685af req-84f40512-fe41-41c0-b2d2-72aed791bb58 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:59.535230 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-64ed12ca-6e64-48df-9747-3da765f685af req-84f40512-fe41-41c0-b2d2-72aed791bb58 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:59.535230 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-64ed12ca-6e64-48df-9747-3da765f685af req-84f40512-fe41-41c0-b2d2-72aed791bb58 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:59.552271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-64ed12ca-6e64-48df-9747-3da765f685af req-84f40512-fe41-41c0-b2d2-72aed791bb58 service nova] Creating event network-vif-deleted:093eee48-f69e-45f9-8131-16d82edc3341 for instance 821b76aa-235d-42ca-aec6-6597a19525c0 on hv-cinder-85427 Aug 24 06:47:59.559327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-64ed12ca-6e64-48df-9747-3da765f685af req-84f40512-fe41-41c0-b2d2-72aed791bb58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051596 Aug 24 06:47:59.560620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 433/840] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:48:00.355857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:00.356630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:00.364055 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:00.364563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:00.365004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:00.365751 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:00.366212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:00.366775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:00.404620 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:00.405626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:00.405626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:00.406009 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lazy-loading 'fault' on Instance uuid 821b76aa-235d-42ca-aec6-6597a19525c0 {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:48:00.458617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:00.469413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3502d2e5-58fc-48f6-8453-9b21c4d93492 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 200 len: 1328 microversion: 2.1 time: 0.118440 Aug 24 06:48:00.469996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 408/841] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:00 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:01.492389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:01.493081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:01.499998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.500482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.500920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.501675 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.502128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.502547 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.517450 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] HTTP exception thrown: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Request method failure captured: Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 HTTP/1.1 Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfrIV4wY3VBWuxA3uVmpOJwqi_lYXqEpcOQ9hAgV7F3zLtoFBUXRwHdb-kG9nYUz3D16Ca50J4NpOmIhIdPzGmbr_dpHfcgSeycuRs3IA34p5kn8ydhaBkvo275rWWXXxH2zBulEVRYfmw7GSeG-Z7AE0KPdtF9kkSg8Q3iqTlv3sw Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:48:01.519091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_096ae1367ad84c7aaa0b5e96e22e9e32", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 8b9b29b53a7b490da29fbf6e5451c362 Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:48:01.520613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '821b76aa-235d-42ca-aec6-6597a19525c0'} Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:01.521816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:48:01.523295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.524632 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Returning 404 to user: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:01.524632 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f3ee27e0-f416-4647-96f4-c533404bc5e6 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 404 len: 111 microversion: 2.1 time: 0.032817 Aug 24 06:48:01.524632 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 434/842] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:01 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:48:01.531945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3cfadc0f-aaeb-4896-aa8d-48e15e8b8238 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '.version_select at 0x7fb5d432b040>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:01.611545 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3cfadc0f-aaeb-4896-aa8d-48e15e8b8238 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416900111" status: 202 len: 0 microversion: 2.1 time: 0.084087 Aug 24 06:48:01.612149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 409/843] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 24 06:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416900111 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:02.414224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0d70e5ae-f16b-4872-8e2b-9b75c20f421c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'create', calling method: .version_select at 0x7fb5d8dd3dc0>, body: {"keypair": {"name": "tempest-keypair-693927803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1YVmoScrOYRPew+oJH3VmjOmZXlMUtaxuMvQc9cg2F95tAtSsD1T8Ss22jjLIEe3Oo3Z/R3VX/8J7Iw6+C0qKD1WwFlCaGV4iF/e4lOCVlR5KDm/LTp9MhsNw3bYabPg=="}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:02.430215 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-0d70e5ae-f16b-4872-8e2b-9b75c20f421c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Getting quotas for project 096ae1367ad84c7aaa0b5e96e22e9e32. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:48:02.434779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-0d70e5ae-f16b-4872-8e2b-9b75c20f421c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Getting quotas for user 8b9b29b53a7b490da29fbf6e5451c362 and project 096ae1367ad84c7aaa0b5e96e22e9e32. Resources: {'key_pairs'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:48:02.543498 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0d70e5ae-f16b-4872-8e2b-9b75c20f421c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133275 Aug 24 06:48:02.544249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 435/844] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:48:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:05.029101 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-349472928", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a22ad074-b1d8-4e4b-a73f-57c112fd6e15"}], "security_groups": [{"name": "tempest-securitygroup--1622812469"}], "key_name": "tempest-keypair-693927803", "user_data": "}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:05.138510 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] validate_networks() for [('a22ad074-b1d8-4e4b-a73f-57c112fd6e15', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:48:05.539214 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:48:05.539634 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:48:05.540108 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:48:05.540524 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:48:05.540939 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:48:05.550198 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:05.551207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:05.551207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:05.551833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:05.552291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:05.552714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:05.573966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Getting quotas for project 096ae1367ad84c7aaa0b5e96e22e9e32. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:48:05.578216 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Getting quotas for user 8b9b29b53a7b490da29fbf6e5451c362 and project 096ae1367ad84c7aaa0b5e96e22e9e32. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:48:05.590563 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:48:05.592962 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:48:05.715703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ef51d6d7-22b3-4474-b3b8-c8c1d2a12968 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.692116 Aug 24 06:48:05.716254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 410/845] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:48:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:48:05.727582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ff0ac4b2-bde0-4a08-9fa2-178f26d3e82f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:05.728201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ff0ac4b2-bde0-4a08-9fa2-178f26d3e82f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:05.793890 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ff0ac4b2-bde0-4a08-9fa2-178f26d3e82f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:05.801437 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ff0ac4b2-bde0-4a08-9fa2-178f26d3e82f tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1236 microversion: 2.1 time: 0.077825 Aug 24 06:48:05.802005 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 436/846] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:05 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:06.825566 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:06.826200 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:06.832564 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:06.833043 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:06.833520 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:06.834220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:06.834681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:06.835101 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:06.898235 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:06.906616 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fa290e3c-1d84-4461-bf6c-0c09b5e9a430 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1240 microversion: 2.1 time: 0.086772 Aug 24 06:48:06.907187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 411/847] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:06 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:07.927898 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:07.928511 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:07.935421 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:07.935924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:07.936361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:07.937069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:07.937557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:07.937990 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:08.004950 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:08.013669 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1fb1e3ca-cffe-43a4-9da3-f5c4c756f4da tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1296 microversion: 2.1 time: 0.089870 Aug 24 06:48:08.014329 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 437/848] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:07 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:09.035779 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:09.036400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:09.044256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:09.044748 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:09.045370 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:09.046092 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:09.046556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:09.047018 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:09.269796 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:09.278335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-df77f384-ced8-4f38-b50a-ed8bf42875dc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1362 microversion: 2.1 time: 0.246757 Aug 24 06:48:09.278940 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 412/849] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:09 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:09.707821 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-49ffc4fa-3704-4602-97d2-5429a5f88991 req-15895268-39e1-47ff-88be-7aa445ea410d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e77cd4-6087-440c-b857-1dc22f18eb4f", "tag": "1de9d1dd-a04a-4e7a-bbbf-54c6c43a4d2e"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:09.718907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-49ffc4fa-3704-4602-97d2-5429a5f88991 req-15895268-39e1-47ff-88be-7aa445ea410d service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:09.719389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-49ffc4fa-3704-4602-97d2-5429a5f88991 req-15895268-39e1-47ff-88be-7aa445ea410d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:09.719814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-49ffc4fa-3704-4602-97d2-5429a5f88991 req-15895268-39e1-47ff-88be-7aa445ea410d service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:09.732834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-49ffc4fa-3704-4602-97d2-5429a5f88991 req-15895268-39e1-47ff-88be-7aa445ea410d service nova] Creating event network-changed:1de9d1dd-a04a-4e7a-bbbf-54c6c43a4d2e for instance 03e77cd4-6087-440c-b857-1dc22f18eb4f on hv-cinder-85427 Aug 24 06:48:09.738041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-49ffc4fa-3704-4602-97d2-5429a5f88991 req-15895268-39e1-47ff-88be-7aa445ea410d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034067 Aug 24 06:48:09.740149 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 438/850] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:10.299676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:10.300362 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:10.307004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:10.307543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:10.308516 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:10.309254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:10.309727 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:10.310154 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:10.517944 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:10.527501 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6281a6d0-f1a8-4a12-946d-1d77155c960c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1362 microversion: 2.1 time: 0.231295 Aug 24 06:48:10.527801 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 413/851] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:10 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:11.550191 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:11.550871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:11.557128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:11.558247 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:11.558721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:11.559446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:11.559887 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:11.560300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:11.699565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:11.707153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2cc86ed4-fe28-47c9-9c4f-9720078d2f92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1362 microversion: 2.1 time: 0.161676 Aug 24 06:48:11.707714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 439/852] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:11 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:12.727870 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:12.728406 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:12.735081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:12.735566 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:12.736004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:12.736700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:12.737161 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:12.737639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:12.873906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:12.881850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bec9af93-493d-4c62-9dc4-e9620bc951e0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1362 microversion: 2.1 time: 0.157868 Aug 24 06:48:12.882210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 414/853] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:12 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:13.904237 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:13.904784 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:13.912219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:13.912696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:13.913124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:13.913832 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:13.914271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:13.914689 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:14.045786 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:14.053376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-22454e6b-111e-4bab-aefa-69f53b913642 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1362 microversion: 2.1 time: 0.153761 Aug 24 06:48:14.063854 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 440/854] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:13 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:15.082960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:15.083567 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:15.090614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:15.091096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:15.091523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:15.092214 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:15.092655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:15.093071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:15.234240 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:15.241970 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-21cfca99-4860-419b-b2df-3d9f49e0c16d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1362 microversion: 2.1 time: 0.163193 Aug 24 06:48:15.242543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 415/855] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:15 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:16.264208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:16.264855 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:16.267318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=6 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:16.272383 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:16.272862 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:16.273335 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:16.274023 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:16.274466 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:16.274899 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:16.411986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:16.420320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ea4762ed-ee96-4dc5-af0a-62c206d54b5e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1362 microversion: 2.1 time: 0.160463 Aug 24 06:48:16.420892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 441/856] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:16 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:17.001022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-bbee4d52-a74a-487e-903b-969c7d56442b req-1b69e48d-e486-4f53-8363-a65fbb03ea41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e77cd4-6087-440c-b857-1dc22f18eb4f", "name": "network-vif-plugged", "status": "completed", "tag": "1de9d1dd-a04a-4e7a-bbbf-54c6c43a4d2e"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:17.006206 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:17.006885 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=6 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:17.013640 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-bbee4d52-a74a-487e-903b-969c7d56442b req-1b69e48d-e486-4f53-8363-a65fbb03ea41 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:17.016958 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-bbee4d52-a74a-487e-903b-969c7d56442b req-1b69e48d-e486-4f53-8363-a65fbb03ea41 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:17.016958 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-bbee4d52-a74a-487e-903b-969c7d56442b req-1b69e48d-e486-4f53-8363-a65fbb03ea41 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:17.025592 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-bbee4d52-a74a-487e-903b-969c7d56442b req-1b69e48d-e486-4f53-8363-a65fbb03ea41 service nova] Creating event network-vif-plugged:1de9d1dd-a04a-4e7a-bbbf-54c6c43a4d2e for instance 03e77cd4-6087-440c-b857-1dc22f18eb4f on hv-cinder-85427 Aug 24 06:48:17.031453 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-bbee4d52-a74a-487e-903b-969c7d56442b req-1b69e48d-e486-4f53-8363-a65fbb03ea41 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034048 Aug 24 06:48:17.032044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 416/857] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:48:17.442838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:17.443491 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:17.450252 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:17.451670 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:17.452003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:17.452699 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:17.453170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:17.453614 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:17.589873 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:17.598216 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-798cbfba-5827-441d-b5f8-dc05c99186fc tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1362 microversion: 2.1 time: 0.159761 Aug 24 06:48:17.598788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 442/858] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:17 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:18.619431 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:18.620155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:18.628549 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:18.629025 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:18.629543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:18.630247 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:18.630693 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:18.631110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:18.770823 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:18.779378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-893b90e6-ea1c-4297-ad50-9031b78331ca tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1362 microversion: 2.1 time: 0.164181 Aug 24 06:48:18.779943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 417/859] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:18 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:19.799486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:19.800094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:19.806778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:19.807259 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:19.807689 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:19.808374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:19.808817 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:19.809250 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:19.941222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:19.949170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9d69b8fc-eca3-4084-8b85-e26d2f1d9a2a tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1548 microversion: 2.1 time: 0.153474 Aug 24 06:48:19.949764 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 443/860] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:19 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:19.969938 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ef577935-4e9d-45ef-a1fa-e62a23f47de0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:19.970510 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ef577935-4e9d-45ef-a1fa-e62a23f47de0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:19.977361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef577935-4e9d-45ef-a1fa-e62a23f47de0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:19.977880 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef577935-4e9d-45ef-a1fa-e62a23f47de0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:19.978372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef577935-4e9d-45ef-a1fa-e62a23f47de0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:19.979090 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef577935-4e9d-45ef-a1fa-e62a23f47de0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:19.983187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef577935-4e9d-45ef-a1fa-e62a23f47de0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:19.983187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ef577935-4e9d-45ef-a1fa-e62a23f47de0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:20.063114 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ef577935-4e9d-45ef-a1fa-e62a23f47de0 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097572 Aug 24 06:48:20.063706 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 418/861] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 24 06:48:19 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:21.113479 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-b658c711-3c5c-441a-af6d-b2277f6ded26 req-c3c0a192-4726-44de-acd4-9a21aa051147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e77cd4-6087-440c-b857-1dc22f18eb4f", "tag": "1de9d1dd-a04a-4e7a-bbbf-54c6c43a4d2e"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:21.123413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-b658c711-3c5c-441a-af6d-b2277f6ded26 req-c3c0a192-4726-44de-acd4-9a21aa051147 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:21.123880 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-b658c711-3c5c-441a-af6d-b2277f6ded26 req-c3c0a192-4726-44de-acd4-9a21aa051147 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:21.124297 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-b658c711-3c5c-441a-af6d-b2277f6ded26 req-c3c0a192-4726-44de-acd4-9a21aa051147 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:21.135978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-b658c711-3c5c-441a-af6d-b2277f6ded26 req-c3c0a192-4726-44de-acd4-9a21aa051147 service nova] Creating event network-changed:1de9d1dd-a04a-4e7a-bbbf-54c6c43a4d2e for instance 03e77cd4-6087-440c-b857-1dc22f18eb4f on hv-cinder-85427 Aug 24 06:48:21.141666 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-b658c711-3c5c-441a-af6d-b2277f6ded26 req-c3c0a192-4726-44de-acd4-9a21aa051147 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031692 Aug 24 06:48:21.142378 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 444/862] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:26.989667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:26.990401 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:26.996058 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:26.996557 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:26.996986 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:26.997966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:26.998467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:26.998796 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:27.001400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=71 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:27.082594 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lazy-loading 'services' on Instance uuid ee546bf2-d24c-41cb-925a-b8c8ddd29697 {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:48:27.301390 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-64bf3ae1-030d-4c67-a9dd-9d92b0d8df81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments/59b93249-085e-43d4-94a6-ad144874cd76" status: 202 len: 0 microversion: 2.1 time: 0.316110 Aug 24 06:48:27.301971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 419/863] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:48:26 2022] DELETE /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments/59b93249-085e-43d4-94a6-ad144874cd76 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:27.311253 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9c3691bc-f516-4a44-b488-cba1a731c6ec tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:27.313810 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9c3691bc-f516-4a44-b488-cba1a731c6ec tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:27.315409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:27.320453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c3691bc-f516-4a44-b488-cba1a731c6ec tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:27.320944 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c3691bc-f516-4a44-b488-cba1a731c6ec tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:27.321412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c3691bc-f516-4a44-b488-cba1a731c6ec tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:27.322349 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c3691bc-f516-4a44-b488-cba1a731c6ec tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:27.322546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c3691bc-f516-4a44-b488-cba1a731c6ec tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:27.322967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c3691bc-f516-4a44-b488-cba1a731c6ec tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:27.355210 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9c3691bc-f516-4a44-b488-cba1a731c6ec tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048647 Aug 24 06:48:27.355765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 445/864] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:48:27 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:28.369110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e25a8555-2ffe-459f-b56a-f64f94abddf0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:28.371588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e25a8555-2ffe-459f-b56a-f64f94abddf0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:28.378941 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e25a8555-2ffe-459f-b56a-f64f94abddf0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:28.379447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e25a8555-2ffe-459f-b56a-f64f94abddf0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:28.379884 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e25a8555-2ffe-459f-b56a-f64f94abddf0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:28.380593 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e25a8555-2ffe-459f-b56a-f64f94abddf0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:28.381051 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e25a8555-2ffe-459f-b56a-f64f94abddf0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:28.381506 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e25a8555-2ffe-459f-b56a-f64f94abddf0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:28.415726 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e25a8555-2ffe-459f-b56a-f64f94abddf0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051371 Aug 24 06:48:28.422245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 420/865] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:48:28 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:29.428562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-34521ce0-2bc5-4365-b513-49614527b92e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:29.430765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-34521ce0-2bc5-4365-b513-49614527b92e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:29.437721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34521ce0-2bc5-4365-b513-49614527b92e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.438211 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34521ce0-2bc5-4365-b513-49614527b92e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.438644 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34521ce0-2bc5-4365-b513-49614527b92e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.439346 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34521ce0-2bc5-4365-b513-49614527b92e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.439795 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34521ce0-2bc5-4365-b513-49614527b92e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.440214 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-34521ce0-2bc5-4365-b513-49614527b92e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.442622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:29.472115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-34521ce0-2bc5-4365-b513-49614527b92e tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047850 Aug 24 06:48:29.472718 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 446/866] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:48:29 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:48:29.552118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:29.552660 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:29.559229 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.559706 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.560242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.560929 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.561411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.561836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.588135 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:48:29.895230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4003e862-03e7-436d-9c05-1fdddb35c2e7 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 204 len: 0 microversion: 2.1 time: 0.346862 Aug 24 06:48:29.895795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 421/867] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:48:29 2022] DELETE /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:48:29.904958 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:29.906128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:29.913413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.918863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.918863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.918863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.918863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.919328 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:30.053772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:30.061981 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-877a6a2b-cc12-40af-9f24-610480224cfd tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1689 microversion: 2.1 time: 0.161918 Aug 24 06:48:30.062546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 447/868] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:29 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:31.084981 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:31.085792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:31.088246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:31.093010 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:31.094158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:31.094614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:31.095305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:31.096077 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:31.096534 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:31.234682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:31.242366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f3cc0a4b-444f-4d12-b863-f0dbd9579d10 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1689 microversion: 2.1 time: 0.161993 Aug 24 06:48:31.242922 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 422/869] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:31 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:32.263047 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:32.263645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:32.270717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:32.271192 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:32.271620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:32.272299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:32.272740 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:32.273152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:32.404956 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:32.413946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-85fb46ea-1564-46a0-af4b-d9c599bb17b3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1689 microversion: 2.1 time: 0.154748 Aug 24 06:48:32.414512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 448/870] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:32 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:33.436684 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:33.437297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:33.445307 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:33.445795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:33.446226 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:33.446931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:33.447378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:33.447793 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:33.587970 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:33.597615 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-038957cd-1551-4bbd-9a1f-8c63e9adf26f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1689 microversion: 2.1 time: 0.164932 Aug 24 06:48:33.598200 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 423/871] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:33 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:34.608338 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-9c456492-41b6-44f8-9dfe-fe87dd32a3b4 req-20337389-2e81-48b4-80e4-3748820675f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee546bf2-d24c-41cb-925a-b8c8ddd29697", "name": "network-vif-deleted", "tag": "ffe40726-5b2e-4cbd-808c-978fb12b7e66"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:34.618749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-9c456492-41b6-44f8-9dfe-fe87dd32a3b4 req-20337389-2e81-48b4-80e4-3748820675f2 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:34.619228 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-9c456492-41b6-44f8-9dfe-fe87dd32a3b4 req-20337389-2e81-48b4-80e4-3748820675f2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:34.619722 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-9c456492-41b6-44f8-9dfe-fe87dd32a3b4 req-20337389-2e81-48b4-80e4-3748820675f2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:34.625072 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:34.625798 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:34.632426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-9c456492-41b6-44f8-9dfe-fe87dd32a3b4 req-20337389-2e81-48b4-80e4-3748820675f2 service nova] Creating event network-vif-deleted:ffe40726-5b2e-4cbd-808c-978fb12b7e66 for instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 on hv-cinder-85427 Aug 24 06:48:34.633691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:34.634252 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:34.634748 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:34.636578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:34.637109 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:34.637628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:34.637773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-9c456492-41b6-44f8-9dfe-fe87dd32a3b4 req-20337389-2e81-48b4-80e4-3748820675f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032975 Aug 24 06:48:34.641408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 449/872] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:34.721011 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:34.733029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c461ca9d-7d37-4a86-9702-a11f4ee61c1f tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 200 len: 1621 microversion: 2.1 time: 0.116687 Aug 24 06:48:34.733780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 424/873] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:34 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 1621 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:35.757145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:35.758819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: ee546bf2-d24c-41cb-925a-b8c8ddd29697] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:35.765474 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:35.770234 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:35.770234 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:35.770234 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:35.770234 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:35.770599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] HTTP exception thrown: Instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 could not be found. Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Request method failure captured: Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 HTTP/1.1 Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBchMQjcmjijIBhpNwhXBtxs1VYqlxbDph_btSBqtQJD0W420IcVXlkq_bxPzo9Wo0IAQ0x7-Rc5rZFp87wdxqiPq9b8-SlxrXff7vRJvQ8OS4DfdDyvZmhbpacyJWfoSCxJ4jHaBYaZmu0BXGlG7tEmEDNtFuu-zYjfP3jWErKuEk_I Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:48:35.786185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50896ec327454f28b1987cd4271b6e27", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 026744699ed54dce8dc240e44e8aefb3 Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 could not be found. Aug 24 06:48:35.788009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': 'ee546bf2-d24c-41cb-925a-b8c8ddd29697'} Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 could not be found. Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:35.788954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 could not be found. Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 could not be found. Aug 24 06:48:35.790552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:35.791968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Returning 404 to user: Instance ee546bf2-d24c-41cb-925a-b8c8ddd29697 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:35.791968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c1a04c6d-0a4d-48a6-be5e-265b0d2b3ea0 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697" status: 404 len: 111 microversion: 2.1 time: 0.035405 Aug 24 06:48:35.791968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 450/874] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:35 2022] GET /compute/v2.1/servers/ee546bf2-d24c-41cb-925a-b8c8ddd29697 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:48:35.797310 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ef18100c-b72d-4139-b971-b74450a8e910 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '.version_select at 0x7fb5d4544ee0>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:35.935590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ef18100c-b72d-4139-b971-b74450a8e910 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723680348" status: 202 len: 0 microversion: 2.1 time: 0.142484 Aug 24 06:48:35.936167 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 425/875] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 24 06:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723680348 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:39.316797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:39.317368 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:39.323401 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.323875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.324300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.324980 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.325444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.325858 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.355589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:48:39.690627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0651e096-99bd-4d68-8c54-8302ea2920d5 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 204 len: 0 microversion: 2.1 time: 0.377599 Aug 24 06:48:39.691236 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 451/876] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:48:39 2022] DELETE /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:48:39.700521 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:39.701217 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:39.709774 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.710257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.710692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.711387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.711838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.712257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.849424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:39.857382 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f3f6869a-856a-40be-8d7a-8cf45ac349c3 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1508 microversion: 2.1 time: 0.161672 Aug 24 06:48:39.857948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 426/877] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:39 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:40.880129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:40.880822 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:40.887415 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.887896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.888329 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:40.889015 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.889493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.889909 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:41.030361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:41.039525 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-fa500bbd-97ea-49f2-af4f-7fcb8ad81ccc tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1508 microversion: 2.1 time: 0.164095 Aug 24 06:48:41.040118 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 452/878] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:40 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:41.987929 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-12fd527a-e22f-43f3-94d7-c06441427786 req-0a589511-9e1a-441d-9187-adead4828e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adfd4e5-f3c8-444f-99f9-d084d14aae09", "name": "network-vif-deleted", "tag": "c3fa2262-7172-4ec4-8561-3e3a0af603de"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:42.005676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-12fd527a-e22f-43f3-94d7-c06441427786 req-0a589511-9e1a-441d-9187-adead4828e9f service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.006571 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-12fd527a-e22f-43f3-94d7-c06441427786 req-0a589511-9e1a-441d-9187-adead4828e9f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.007317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-12fd527a-e22f-43f3-94d7-c06441427786 req-0a589511-9e1a-441d-9187-adead4828e9f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.028509 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-12fd527a-e22f-43f3-94d7-c06441427786 req-0a589511-9e1a-441d-9187-adead4828e9f service nova] Creating event network-vif-deleted:c3fa2262-7172-4ec4-8561-3e3a0af603de for instance 4adfd4e5-f3c8-444f-99f9-d084d14aae09 on hv-cinder-85427 Aug 24 06:48:42.038085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-12fd527a-e22f-43f3-94d7-c06441427786 req-0a589511-9e1a-441d-9187-adead4828e9f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054671 Aug 24 06:48:42.039127 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 427/879] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:42.060152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:42.060779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:42.071408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.071904 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.072427 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.073229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.073687 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.074129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.139008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:42.148104 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-dbfeb66c-7fde-4cc8-8502-f90dc894ec01 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 200 len: 1466 microversion: 2.1 time: 0.091852 Aug 24 06:48:42.148636 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 453/880] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:42 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 1466 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:43.170230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:43.170921 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: 4adfd4e5-f3c8-444f-99f9-d084d14aae09] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:43.177623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.178309 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.178533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.179218 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.179665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.180082 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.193846 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] HTTP exception thrown: Instance 4adfd4e5-f3c8-444f-99f9-d084d14aae09 could not be found. Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Request method failure captured: Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 HTTP/1.1 Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBchMQjcmjijIBhpNwhXBtxs1VYqlxbDph_btSBqtQJD0W420IcVXlkq_bxPzo9Wo0IAQ0x7-Rc5rZFp87wdxqiPq9b8-SlxrXff7vRJvQ8OS4DfdDyvZmhbpacyJWfoSCxJ4jHaBYaZmu0BXGlG7tEmEDNtFuu-zYjfP3jWErKuEk_I Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:48:43.195469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50896ec327454f28b1987cd4271b6e27", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 026744699ed54dce8dc240e44e8aefb3 Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 4adfd4e5-f3c8-444f-99f9-d084d14aae09 could not be found. Aug 24 06:48:43.197210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '4adfd4e5-f3c8-444f-99f9-d084d14aae09'} Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4adfd4e5-f3c8-444f-99f9-d084d14aae09 could not be found. Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:43.208289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4adfd4e5-f3c8-444f-99f9-d084d14aae09 could not be found. Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4adfd4e5-f3c8-444f-99f9-d084d14aae09 could not be found. Aug 24 06:48:43.210372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.211743 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Returning 404 to user: Instance 4adfd4e5-f3c8-444f-99f9-d084d14aae09 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:43.211743 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ebe33bf4-49b6-46f4-9df9-6a575e68924a tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09" status: 404 len: 111 microversion: 2.1 time: 0.031030 Aug 24 06:48:43.211743 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 428/881] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:43 2022] GET /compute/v2.1/servers/4adfd4e5-f3c8-444f-99f9-d084d14aae09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:48:43.212001 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:43.212001 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:43.213462 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.213947 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.214379 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.215074 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.215525 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.215950 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.255175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:48:43.546266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-925f556b-2020-4abf-b141-049859b279cb tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "DELETE /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 204 len: 0 microversion: 2.1 time: 0.343881 Aug 24 06:48:43.546770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 454/882] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:48:43 2022] DELETE /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:48:43.555550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:43.556149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:43.562332 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.562835 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.563285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.564055 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.564503 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.564919 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.701343 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:43.716928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-84f28430-b140-479e-be56-e9d3ffdbda81 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.165157 Aug 24 06:48:43.717536 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 429/883] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:43 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:44.740656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:44.741299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:44.748187 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:44.748806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:44.749280 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:44.750049 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:44.750505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:44.751535 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:44.887944 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:44.897105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-386f8578-d466-4858-8e65-59943106096c tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.160964 Aug 24 06:48:44.897862 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 455/884] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:44 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:45.919409 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:45.919945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:45.927442 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:45.927957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:45.928427 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:45.929157 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:45.929635 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:45.930062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:46.375515 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:46.392384 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7c672f81-094e-4ae1-9ae2-f7964a2fdc85 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1521 microversion: 2.1 time: 0.475848 Aug 24 06:48:46.393448 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 430/885] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:45 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:46.842588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-c9d19f54-4c59-432f-8af0-62a07b2e4ea1 req-08b38643-50cb-4a23-80d1-46bcfd01a89e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb56c577-522f-4ef5-a3e2-d65c466ebdda", "name": "network-vif-deleted", "tag": "4f95b5cf-f500-4e87-abba-fb8400f87b79"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:46.853051 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-c9d19f54-4c59-432f-8af0-62a07b2e4ea1 req-08b38643-50cb-4a23-80d1-46bcfd01a89e service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:46.853554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-c9d19f54-4c59-432f-8af0-62a07b2e4ea1 req-08b38643-50cb-4a23-80d1-46bcfd01a89e service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:46.853975 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-c9d19f54-4c59-432f-8af0-62a07b2e4ea1 req-08b38643-50cb-4a23-80d1-46bcfd01a89e service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:46.866096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-c9d19f54-4c59-432f-8af0-62a07b2e4ea1 req-08b38643-50cb-4a23-80d1-46bcfd01a89e service nova] Creating event network-vif-deleted:4f95b5cf-f500-4e87-abba-fb8400f87b79 for instance eb56c577-522f-4ef5-a3e2-d65c466ebdda on hv-cinder-85427 Aug 24 06:48:46.871244 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-c9d19f54-4c59-432f-8af0-62a07b2e4ea1 req-08b38643-50cb-4a23-80d1-46bcfd01a89e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032500 Aug 24 06:48:46.871823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 456/886] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:47.414323 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:47.414946 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:47.421395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.421881 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.422325 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.423815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.424311 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.424742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.460230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.461078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.461886 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.462674 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lazy-loading 'fault' on Instance uuid eb56c577-522f-4ef5-a3e2-d65c466ebdda {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:48:47.513760 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026744699ed54dce8dc240e44e8aefb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50896ec327454f28b1987cd4271b6e27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:47.523100 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-54103511-a50e-483a-8a2a-cf15f96d0130 tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 200 len: 1311 microversion: 2.1 time: 0.112700 Aug 24 06:48:47.523890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 431/887] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:47 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:48.546625 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:48.547234 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] [instance: eb56c577-522f-4ef5-a3e2-d65c466ebdda] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:48.555148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.556106 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.556696 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:48.557825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.558313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.558738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:48.573324 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] HTTP exception thrown: Instance eb56c577-522f-4ef5-a3e2-d65c466ebdda could not be found. Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Request method failure captured: Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda HTTP/1.1 Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBchMQjcmjijIBhpNwhXBtxs1VYqlxbDph_btSBqtQJD0W420IcVXlkq_bxPzo9Wo0IAQ0x7-Rc5rZFp87wdxqiPq9b8-SlxrXff7vRJvQ8OS4DfdDyvZmhbpacyJWfoSCxJ4jHaBYaZmu0BXGlG7tEmEDNtFuu-zYjfP3jWErKuEk_I Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:48:48.575054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50896ec327454f28b1987cd4271b6e27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50896ec327454f28b1987cd4271b6e27", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 50896ec327454f28b1987cd4271b6e27 Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1815517821 Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 026744699ed54dce8dc240e44e8aefb3 Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1815517821-project Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance eb56c577-522f-4ef5-a3e2-d65c466ebdda could not be found. Aug 24 06:48:48.576534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': 'eb56c577-522f-4ef5-a3e2-d65c466ebdda'} Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb56c577-522f-4ef5-a3e2-d65c466ebdda could not be found. Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:48.577476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb56c577-522f-4ef5-a3e2-d65c466ebdda could not be found. Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb56c577-522f-4ef5-a3e2-d65c466ebdda could not be found. Aug 24 06:48:48.578976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:48:48.580886 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] Returning 404 to user: Instance eb56c577-522f-4ef5-a3e2-d65c466ebdda could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:48.580886 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-26b0966b-ae53-4fdd-b838-fd91cf80daff tempest-ServerRescueNegativeTestJSON-1815517821 tempest-ServerRescueNegativeTestJSON-1815517821-project] 10.222.0.47 "GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda" status: 404 len: 111 microversion: 2.1 time: 0.034727 Aug 24 06:48:48.580886 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 457/888] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:48 2022] GET /compute/v2.1/servers/eb56c577-522f-4ef5-a3e2-d65c466ebdda => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:48:56.113201 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f5d7590e-c246-478b-88a1-44999a695c94 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d432b040>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:56.164245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f5d7590e-c246-478b-88a1-44999a695c94 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a2037309-3e70-4203-bd26-5bd2ba22a0a4" status: 200 len: 351 microversion: 2.1 time: 0.055358 Aug 24 06:48:56.164811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 432/889] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:48:56 2022] GET /compute/v2.1/os-volumes/a2037309-3e70-4203-bd26-5bd2ba22a0a4 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:57.782200 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3e664f53-3c33-4ba2-ad6b-4580508e5da2 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d8d3a790>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:57.848841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3e664f53-3c33-4ba2-ad6b-4580508e5da2 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e4965f57-7290-463d-8b06-c2b266510c96" status: 200 len: 351 microversion: 2.1 time: 0.069551 Aug 24 06:48:57.849761 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 458/890] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:48:57 2022] GET /compute/v2.1/os-volumes/e4965f57-7290-463d-8b06-c2b266510c96 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:48:59.493752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:59.494777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:59.498744 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8bf29e37-9392-4ee8-8ec7-d5f2fddb8264 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d4531280>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:59.548316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8bf29e37-9392-4ee8-8ec7-d5f2fddb8264 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6b036158-16ae-43ee-be8a-a8f7825fbde3" status: 200 len: 351 microversion: 2.1 time: 0.055991 Aug 24 06:48:59.548905 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 433/891] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:48:59 2022] GET /compute/v2.1/os-volumes/6b036158-16ae-43ee-be8a-a8f7825fbde3 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:59.558750 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:59.559520 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:59.563990 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-30179791-148a-4132-8f8a-cbc6db87bfaa tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d8d838b0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:59.652759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-30179791-148a-4132-8f8a-cbc6db87bfaa tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.094750 Aug 24 06:48:59.657695 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 459/892] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Aug 24 06:48:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:59.668080 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bd2d075c-7521-4cca-b8a5-3355949f07f0 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d4531f70>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:59.755934 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bd2d075c-7521-4cca-b8a5-3355949f07f0 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.092378 Aug 24 06:48:59.761277 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 434/893] 10.222.0.47 () {58 vars in 1149 bytes} [Wed Aug 24 06:48:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:48:59.770249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e77f738d-b32b-457e-8655-fcc39e666818 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d8d3a4c0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:59.856056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e77f738d-b32b-457e-8655-fcc39e666818 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089390 Aug 24 06:48:59.856631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 460/894] 10.222.0.47 () {58 vars in 1134 bytes} [Wed Aug 24 06:48:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:59.869414 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-84d27d6c-517f-4088-878f-ee1df5807890 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d432b700>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:59.953219 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-84d27d6c-517f-4088-878f-ee1df5807890 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087706 Aug 24 06:48:59.953800 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 435/895] 10.222.0.47 () {58 vars in 1167 bytes} [Wed Aug 24 06:48:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:59.968109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8688f9f8-e7d1-47cb-896a-3c976e622228 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d8dadaf0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:00.207030 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8688f9f8-e7d1-47cb-896a-3c976e622228 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.242701 Aug 24 06:49:00.207595 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 461/896] 10.222.0.47 () {58 vars in 1170 bytes} [Wed Aug 24 06:48:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:00.221881 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1cd41501-e5af-41cf-b029-2399efe8e335 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d4531160>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:00.308260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1cd41501-e5af-41cf-b029-2399efe8e335 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.090350 Aug 24 06:49:00.308850 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 436/897] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Aug 24 06:49:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:00.322645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6b9a23eb-62d7-4e8a-bf6f-65e9067db4bf tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d8d5e8b0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:00.408326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6b9a23eb-62d7-4e8a-bf6f-65e9067db4bf tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090496 Aug 24 06:49:00.408926 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 462/898] 10.222.0.47 () {58 vars in 1188 bytes} [Wed Aug 24 06:49:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:00.422627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c981ccf1-74aa-4548-b1c2-09b2a17e4509 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] Calling method '.version_select at 0x7fb5d458d280>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:00.510246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c981ccf1-74aa-4548-b1c2-09b2a17e4509 tempest-VolumesTestJSON-1513742994 tempest-VolumesTestJSON-1513742994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.091339 Aug 24 06:49:00.515067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 437/899] 10.222.0.47 () {58 vars in 1155 bytes} [Wed Aug 24 06:49:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:03.520090 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a89cb87f-7d70-48c9-b28f-5b5d7eec5818 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:03.520641 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a89cb87f-7d70-48c9-b28f-5b5d7eec5818 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:03.527530 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a89cb87f-7d70-48c9-b28f-5b5d7eec5818 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.528065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a89cb87f-7d70-48c9-b28f-5b5d7eec5818 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.528500 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a89cb87f-7d70-48c9-b28f-5b5d7eec5818 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.529207 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a89cb87f-7d70-48c9-b28f-5b5d7eec5818 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.529667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a89cb87f-7d70-48c9-b28f-5b5d7eec5818 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.530088 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a89cb87f-7d70-48c9-b28f-5b5d7eec5818 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.554600 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a89cb87f-7d70-48c9-b28f-5b5d7eec5818 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/ips" status: 200 len: 150 microversion: 2.1 time: 0.038401 Aug 24 06:49:03.557806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 463/900] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:49:03 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:05.248285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c5d3801c-34b5-4d36-8dbc-84b230c7a1d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70ed3287-4810-459d-8d55-9f8cd2833c94"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:05.250658 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c5d3801c-34b5-4d36-8dbc-84b230c7a1d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:05.257009 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5d3801c-34b5-4d36-8dbc-84b230c7a1d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:05.259184 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5d3801c-34b5-4d36-8dbc-84b230c7a1d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:05.259184 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5d3801c-34b5-4d36-8dbc-84b230c7a1d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:05.259184 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5d3801c-34b5-4d36-8dbc-84b230c7a1d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:05.259461 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5d3801c-34b5-4d36-8dbc-84b230c7a1d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:05.259869 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c5d3801c-34b5-4d36-8dbc-84b230c7a1d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:06.052628 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c5d3801c-34b5-4d36-8dbc-84b230c7a1d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.809113 Aug 24 06:49:06.053261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 438/901] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:49:05 2022] POST /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments => generated 194 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:13.581817 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5b7d9ef0-c95d-4d2d-8db1-afe0815c31f6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:13.582408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5b7d9ef0-c95d-4d2d-8db1-afe0815c31f6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:13.584463 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:13.585100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=4 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:13.590315 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5b7d9ef0-c95d-4d2d-8db1-afe0815c31f6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:13.590790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5b7d9ef0-c95d-4d2d-8db1-afe0815c31f6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:13.591218 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5b7d9ef0-c95d-4d2d-8db1-afe0815c31f6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:13.591900 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5b7d9ef0-c95d-4d2d-8db1-afe0815c31f6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:13.592350 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5b7d9ef0-c95d-4d2d-8db1-afe0815c31f6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:13.592759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5b7d9ef0-c95d-4d2d-8db1-afe0815c31f6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:13.617408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5b7d9ef0-c95d-4d2d-8db1-afe0815c31f6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/ips" status: 200 len: 152 microversion: 2.20 time: 0.039374 Aug 24 06:49:13.618078 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 464/902] 10.222.0.47 () {60 vars in 1289 bytes} [Wed Aug 24 06:49:13 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:49:14.656819 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70ed3287-4810-459d-8d55-9f8cd2833c94"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:14.659306 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:14.665550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:14.666029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:14.666451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:14.667135 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:14.667584 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:14.667993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:14.749720 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Invalid volume: volume 70ed3287-4810-459d-8d55-9f8cd2833c94 is already attached to instances: 086395fc-028c-495d-993a-8fee70809181 Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: POST /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments HTTP/1.1 Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 74 Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:49:14.751559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {"volumeAttachment": {"volumeId": "70ed3287-4810-459d-8d55-9f8cd2833c94"}} Aug 24 06:49:14.753045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Invalid volume: volume 70ed3287-4810-459d-8d55-9f8cd2833c94 is already attached to instances: 086395fc-028c-495d-993a-8fee70809181 Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'server_id': '086395fc-028c-495d-993a-8fee70809181', 'body': {'volumeAttachment': {'volumeId': '70ed3287-4810-459d-8d55-9f8cd2833c94'}}} Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 70ed3287-4810-459d-8d55-9f8cd2833c94 is already attached to instances: 086395fc-028c-495d-993a-8fee70809181 Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:49:14.753854 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 70ed3287-4810-459d-8d55-9f8cd2833c94 is already attached to instances: 086395fc-028c-495d-993a-8fee70809181 Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:14.755248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:49:14.756737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:49:14.756737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:49:14.756737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:49:14.756737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 70ed3287-4810-459d-8d55-9f8cd2833c94 is already attached to instances: 086395fc-028c-495d-993a-8fee70809181 Aug 24 06:49:14.756737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:49:14.756737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 400 to user: Invalid volume: volume 70ed3287-4810-459d-8d55-9f8cd2833c94 is already attached to instances: 086395fc-028c-495d-993a-8fee70809181 {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:49:14.756737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4c3dcfea-4842-41ea-a2ff-08101f9b3a14 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101283 Aug 24 06:49:14.756737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 439/903] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:49:14 2022] POST /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:49:14.818785 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:14.819319 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:14.826204 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:14.826976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:14.827141 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:14.827799 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:14.828239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:14.828656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:14.916373 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lazy-loading 'services' on Instance uuid 086395fc-028c-495d-993a-8fee70809181 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:49:15.145279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-81b36bef-b4df-4f40-8d0b-a9da0d13510c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments/70ed3287-4810-459d-8d55-9f8cd2833c94" status: 202 len: 0 microversion: 2.1 time: 0.330486 Aug 24 06:49:15.145873 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 465/904] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:49:14 2022] DELETE /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments/70ed3287-4810-459d-8d55-9f8cd2833c94 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:49:15.159956 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-61259279-b1ba-492e-a416-892b4c652300 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:15.162199 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-61259279-b1ba-492e-a416-892b4c652300 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:15.169263 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61259279-b1ba-492e-a416-892b4c652300 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:15.169749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61259279-b1ba-492e-a416-892b4c652300 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:15.170175 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61259279-b1ba-492e-a416-892b4c652300 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:15.170861 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61259279-b1ba-492e-a416-892b4c652300 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:15.171305 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61259279-b1ba-492e-a416-892b4c652300 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:15.171721 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61259279-b1ba-492e-a416-892b4c652300 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:15.201574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-61259279-b1ba-492e-a416-892b4c652300 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Aug 24 06:49:15.202124 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 440/905] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:49:15 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:16.215435 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8291cf55-d547-43d0-97eb-4c93fae2edb8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:16.217757 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8291cf55-d547-43d0-97eb-4c93fae2edb8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:16.224149 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8291cf55-d547-43d0-97eb-4c93fae2edb8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:16.224621 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8291cf55-d547-43d0-97eb-4c93fae2edb8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:16.225090 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8291cf55-d547-43d0-97eb-4c93fae2edb8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:16.225853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8291cf55-d547-43d0-97eb-4c93fae2edb8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:16.226289 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8291cf55-d547-43d0-97eb-4c93fae2edb8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:16.232808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8291cf55-d547-43d0-97eb-4c93fae2edb8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:16.257955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8291cf55-d547-43d0-97eb-4c93fae2edb8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047430 Aug 24 06:49:16.258572 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 466/906] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:49:16 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:17.269515 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6cb7ab41-3fe0-4210-93c0-032edb9259fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:17.271673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6cb7ab41-3fe0-4210-93c0-032edb9259fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:17.278676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6cb7ab41-3fe0-4210-93c0-032edb9259fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:17.279146 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6cb7ab41-3fe0-4210-93c0-032edb9259fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:17.279584 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6cb7ab41-3fe0-4210-93c0-032edb9259fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:17.280284 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6cb7ab41-3fe0-4210-93c0-032edb9259fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:17.280780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6cb7ab41-3fe0-4210-93c0-032edb9259fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:17.281218 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6cb7ab41-3fe0-4210-93c0-032edb9259fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:17.311351 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6cb7ab41-3fe0-4210-93c0-032edb9259fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045772 Aug 24 06:49:17.311916 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 441/907] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:49:17 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:18.325214 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2a384d00-b440-44d9-9d75-d4425dd2f3f2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:18.327383 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2a384d00-b440-44d9-9d75-d4425dd2f3f2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:18.334093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a384d00-b440-44d9-9d75-d4425dd2f3f2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:18.334571 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a384d00-b440-44d9-9d75-d4425dd2f3f2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:18.334999 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a384d00-b440-44d9-9d75-d4425dd2f3f2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:18.335684 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a384d00-b440-44d9-9d75-d4425dd2f3f2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:18.336132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a384d00-b440-44d9-9d75-d4425dd2f3f2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:18.336548 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a384d00-b440-44d9-9d75-d4425dd2f3f2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:18.366092 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2a384d00-b440-44d9-9d75-d4425dd2f3f2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045559 Aug 24 06:49:18.366640 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 467/908] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:49:18 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:49:18.466022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:18.466512 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:18.473500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:18.473987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:18.475888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:18.475888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:18.475888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:18.476327 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:18.503223 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:49:18.802964 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2a8e302d-5fed-43ea-93f0-b0a7b42265a7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 204 len: 0 microversion: 2.1 time: 0.340739 Aug 24 06:49:18.804744 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 442/909] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:49:18 2022] DELETE /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:49:18.814829 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:18.815435 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:18.821980 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:18.822497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:18.822942 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:18.823966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:18.824697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:18.825032 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:18.894108 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:18.894735 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:18.900755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:18.901262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:18.902222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:18.902911 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:18.903356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:18.903772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:18.928391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lazy-loading 'flavor' on Instance uuid 391581a7-43ed-48fd-add7-cbc73108eae4 {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:49:18.968528 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:18.974540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7754bbe0-f4d1-4979-9fc3-487319c33989 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1681 microversion: 2.1 time: 0.163507 Aug 24 06:49:18.975123 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 468/910] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:18 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:19.487927 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d6ec94c9-1317-4415-a94d-9327d7f53b18 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/action" status: 202 len: 0 microversion: 2.20 time: 0.598573 Aug 24 06:49:19.488528 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 443/911] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 24 06:49:18 2022] POST /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:49:19.496833 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:19.497573 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:19.504348 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:19.504827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:19.505296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:19.505984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:19.506437 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:19.506854 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:19.641986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:19.650111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:19.651786 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:19.653009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0eb0a5ca-09e0-4b66-ab9b-1a2cb8c110f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.160178 Aug 24 06:49:19.653534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 469/912] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:19 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:19.997257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:19.997976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:20.004270 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:20.004739 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:20.005162 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:20.006023 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:20.006541 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:20.006960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:20.148203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:20.156277 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3fe7bf76-d18b-4af2-b489-493e516ead67 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1681 microversion: 2.1 time: 0.163899 Aug 24 06:49:20.156812 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 444/913] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:19 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:20.676998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:20.677619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:20.684957 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:20.685529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:20.686007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:20.686862 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:20.687314 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:20.687729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:20.817173 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:20.825487 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:20.826989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:20.828137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-558538b1-0104-42fd-abd6-447a84449e93 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.155108 Aug 24 06:49:20.828703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 470/914] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:20 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:21.177914 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:21.178513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:21.185037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:21.185583 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:21.186079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:21.186765 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:21.187208 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:21.187622 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:21.377566 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:21.385562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b5cfff35-06a9-4ee9-87fc-979dd4b82c84 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1681 microversion: 2.1 time: 0.211477 Aug 24 06:49:21.386695 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 445/915] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:21 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:21.857366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:21.858523 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:21.865535 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:21.866020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:21.866607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:21.867378 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:21.867833 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:21.868248 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:22.035615 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:22.049277 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:22.049277 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:22.049277 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-eb6f987a-a008-44a5-9160-90dfc2d7e689 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.195357 Aug 24 06:49:22.049694 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 471/916] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:21 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:22.127787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-2a0c094c-d046-4ff7-a244-db325297cf71 req-7bbc7821-5e6d-4c2f-8da0-97abcabe92be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086395fc-028c-495d-993a-8fee70809181", "name": "network-vif-deleted", "tag": "3a5db911-d33c-4154-8327-fcf2006fa1a4"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:22.139736 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-2a0c094c-d046-4ff7-a244-db325297cf71 req-7bbc7821-5e6d-4c2f-8da0-97abcabe92be service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:22.140280 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-2a0c094c-d046-4ff7-a244-db325297cf71 req-7bbc7821-5e6d-4c2f-8da0-97abcabe92be service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:22.140893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-2a0c094c-d046-4ff7-a244-db325297cf71 req-7bbc7821-5e6d-4c2f-8da0-97abcabe92be service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:22.157612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-2a0c094c-d046-4ff7-a244-db325297cf71 req-7bbc7821-5e6d-4c2f-8da0-97abcabe92be service nova] Creating event network-vif-deleted:3a5db911-d33c-4154-8327-fcf2006fa1a4 for instance 086395fc-028c-495d-993a-8fee70809181 on hv-cinder-85427 Aug 24 06:49:22.158122 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-2a0c094c-d046-4ff7-a244-db325297cf71 req-7bbc7821-5e6d-4c2f-8da0-97abcabe92be service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Aug 24 06:49:22.158932 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 446/917] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:49:22.408159 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:22.408758 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:22.419819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:22.419819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:22.419819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:22.419819 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:22.420292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:22.420292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:22.485468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:22.495615 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2566e175-20d1-4961-afb5-384ee1a6d2fd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 200 len: 1326 microversion: 2.1 time: 0.091117 Aug 24 06:49:22.503989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 472/918] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:22 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 1326 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:23.073681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:23.074393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:23.086265 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:23.088598 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:23.088598 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:23.088598 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:23.088598 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:23.089222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:23.253855 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:23.264753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:23.277357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:23.277357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-244dbe51-ddd1-405c-a6a4-b4d52ea06f6c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.198543 Aug 24 06:49:23.277357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 447/919] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:23 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:23.518046 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:23.518646 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:23.525105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:23.525624 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:23.526050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:23.527265 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:23.527860 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:23.528276 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:23.543105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 HTTP/1.1 Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:49:23.544891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:49:23.546582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '086395fc-028c-495d-993a-8fee70809181'} Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:49:23.547703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:49:23.549341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:49:23.553529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:49:23.553529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0e34576f-bc7a-43ad-b586-64e287f61aee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 404 len: 111 microversion: 2.1 time: 0.032848 Aug 24 06:49:23.553529 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 473/920] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:23 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:49:23.556021 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-039d87ae-7735-410d-bb98-e78bbd163c21 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '.version_select at 0x7fb5d4544820>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:23.624421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-039d87ae-7735-410d-bb98-e78bbd163c21 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242240487" status: 202 len: 0 microversion: 2.1 time: 0.072085 Aug 24 06:49:23.624809 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 448/921] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 24 06:49:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242240487 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:49:24.293165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:24.293724 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:24.299823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:24.300289 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:24.300892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:24.301609 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:24.302055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:24.306835 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:24.531481 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:24.551531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:24.554759 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:24.555087 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-30156dfe-cb03-4a9d-b323-528d102114fc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: .version_select at 0x7fb5d430e940>, body: {"keypair": {"name": "tempest-keypair-2132266102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqIAn29PCqtx4eP5YH9v8Ym2aXapnOsX7Y30aQXHKV7K2fJDl07RpOHL97v5OLJkS0jy5wMoSJsPefLCAPrGVRQ+zhz35epLntqaeEMeBs13qAiQXBHyjfnGAn93nINrA=="}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:24.557213 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d408caa1-a7bf-44c1-9c49-438c1298f067 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.267827 Aug 24 06:49:24.558776 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 474/922] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:24 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:24.574647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-30156dfe-cb03-4a9d-b323-528d102114fc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for project b91004b0497d487ea8f1f454c03bbca0. Resources: {'key_pairs'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:49:24.579457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-30156dfe-cb03-4a9d-b323-528d102114fc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for user 02ad6cdc4ffe4917a7bbf6814297f980 and project b91004b0497d487ea8f1f454c03bbca0. Resources: {'key_pairs'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:49:24.692236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-30156dfe-cb03-4a9d-b323-528d102114fc tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143965 Aug 24 06:49:24.697304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 449/923] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:49:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:25.582382 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:25.582967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:25.590169 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:25.590652 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:25.591105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:25.591933 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:25.592509 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:25.592924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:25.772298 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:25.782512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:25.786964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:25.786964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-99e52e3d-9c37-4455-baad-c769b6fe0da9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.206957 Aug 24 06:49:25.786964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 475/924] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:25 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:26.814754 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:26.815898 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:26.829395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:26.830290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:26.831072 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:26.832327 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:26.833245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:26.834026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:27.007132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:27.024509 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:27.027630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:27.030671 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8e9b79c6-1a8e-43e5-8b05-ab7aaf5a136a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.224152 Aug 24 06:49:27.031685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 450/925] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:26 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:27.294961 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-915738850", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14e1d9b8-7d9c-4824-8559-f6d63d615d5b"}], "security_groups": [{"name": "tempest-securitygroup--432735004"}], "key_name": "tempest-keypair-2132266102", "user_data": "}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:27.400701 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] validate_networks() for [('14e1d9b8-7d9c-4824-8559-f6d63d615d5b', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:49:27.776981 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:49:27.777426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:49:27.777941 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:49:27.778980 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:49:27.779440 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:49:27.788555 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:27.789060 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:27.789501 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:27.790210 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:27.790678 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:27.791092 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:27.808175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for project b91004b0497d487ea8f1f454c03bbca0. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:49:27.812319 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Getting quotas for user 02ad6cdc4ffe4917a7bbf6814297f980 and project b91004b0497d487ea8f1f454c03bbca0. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:49:27.823049 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:49:27.825596 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:49:27.953950 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-fd5198d5-337b-4a66-ad07-d6ac9be1007f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.663719 Aug 24 06:49:27.954789 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 476/926] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:49:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:49:27.965623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3fbbb801-8f57-420f-9fea-64b0baa20cee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:27.966897 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3fbbb801-8f57-420f-9fea-64b0baa20cee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:28.036840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3fbbb801-8f57-420f-9fea-64b0baa20cee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:28.043651 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3fbbb801-8f57-420f-9fea-64b0baa20cee tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1241 microversion: 2.1 time: 0.081852 Aug 24 06:49:28.045195 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 451/927] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:27 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:28.070428 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:28.071062 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:28.077794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:28.078270 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:28.078719 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:28.079410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:28.079852 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:28.080266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:28.217281 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:28.225870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:28.227369 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:28.228593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3ddaba6e-6f58-48ed-91d0-9771b7a9c658 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.162549 Aug 24 06:49:28.229375 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 477/928] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:28 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:29.065215 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:29.070467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:29.073153 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:29.073664 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:29.074094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:29.074828 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:29.075772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:29.076190 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:29.140544 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:29.148402 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6463bcdf-ab87-4ac3-ac68-fb3c9fc0c721 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1245 microversion: 2.1 time: 0.087134 Aug 24 06:49:29.148967 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 452/929] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:29 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:29.252483 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:29.253083 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:29.259564 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:29.260051 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:29.260480 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:29.261165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:29.261655 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:29.262075 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:29.397055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:29.405691 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:29.407307 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:29.408645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c4d9d236-729c-4062-89e9-3cbf145bdd80 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.160269 Aug 24 06:49:29.409215 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 478/930] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:29 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:30.171002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:30.171620 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:30.174094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:30.179060 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:30.179556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:30.179973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:30.180667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:30.181115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:30.181565 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:30.201666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:30.274514 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:30.288390 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1439aa47-d61c-4c85-bed0-f9dffa9296f6 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1301 microversion: 2.1 time: 0.121737 Aug 24 06:49:30.289518 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 453/931] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:30 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:30.431263 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:30.431947 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:30.439445 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:30.439915 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:30.440366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:30.441057 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:30.441727 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:30.441984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:30.612844 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:30.620870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:30.622710 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:30.624132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2f200b16-ed18-4e20-b4fd-6d0d81c4cc8f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.197054 Aug 24 06:49:30.625222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 479/932] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:30 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:31.313979 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:31.314615 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:31.322340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:31.323137 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:31.323962 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:31.324673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:31.325327 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:31.325836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:31.525393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:31.534562 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3fb2e4ec-9297-4aa2-a6dd-20492c81d3bb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.225852 Aug 24 06:49:31.538084 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 454/933] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:31 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:31.649674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:31.650538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:31.658505 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:31.658987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:31.659413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:31.660099 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:31.660541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:31.660955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:31.800616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:31.809041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:31.810548 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:31.811805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1d9dfdfd-20b1-45c5-adc6-67466f415d7e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.166217 Aug 24 06:49:31.812524 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 480/934] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:31 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:31.950865 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-64f0d676-19a0-4fa4-8b1e-2dd4e00c0323 req-5068a01d-e450-4bd8-a57f-e26950d667bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48328e6b-2420-4a80-951c-5b3ec8b91c4d", "tag": "2ea9414b-1fc6-4f5d-98b4-e86ba17be292"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:31.962703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-64f0d676-19a0-4fa4-8b1e-2dd4e00c0323 req-5068a01d-e450-4bd8-a57f-e26950d667bf service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:31.963317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-64f0d676-19a0-4fa4-8b1e-2dd4e00c0323 req-5068a01d-e450-4bd8-a57f-e26950d667bf service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:31.963910 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-64f0d676-19a0-4fa4-8b1e-2dd4e00c0323 req-5068a01d-e450-4bd8-a57f-e26950d667bf service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:31.976300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-64f0d676-19a0-4fa4-8b1e-2dd4e00c0323 req-5068a01d-e450-4bd8-a57f-e26950d667bf service nova] Creating event network-changed:2ea9414b-1fc6-4f5d-98b4-e86ba17be292 for instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d on hv-cinder-85427 Aug 24 06:49:31.981522 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-64f0d676-19a0-4fa4-8b1e-2dd4e00c0323 req-5068a01d-e450-4bd8-a57f-e26950d667bf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034142 Aug 24 06:49:31.982128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 455/935] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:32.569261 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:32.569986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:32.576741 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:32.583691 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:32.583691 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:32.583691 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:32.583691 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:32.584328 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:32.605375 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:32.732122 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:32.743341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-21e67d7d-ee5d-49ac-b046-af932ad667be tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.179159 Aug 24 06:49:32.743924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 481/936] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:32 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:32.836590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:32.837246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:32.844161 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:32.844901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:32.845360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:32.846159 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:32.846679 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:32.847098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:32.988608 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:32.996918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:32.998687 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:33.000451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-26578348-ff0c-4217-8823-05aacb5900a7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.168583 Aug 24 06:49:33.000816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 456/937] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:32 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:33.765018 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:33.765643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:33.772298 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:33.772841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:33.773525 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:33.775606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:33.775606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:33.775606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:34.024101 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:34.024725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:34.035167 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:34.035645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:34.037926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:34.037926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:34.037926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:34.037926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:34.071167 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:34.087132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-973ad805-cd08-4fee-8b23-3ba69d901921 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.326516 Aug 24 06:49:34.087701 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 482/938] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:33 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:34.186432 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:34.195088 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:34.196630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:34.197847 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0f72ba9b-c494-4288-9a5f-30ee1dcd2bd5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.177836 Aug 24 06:49:34.201352 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 457/939] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:34 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:35.110738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:35.111339 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:35.117205 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:35.117687 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:35.118121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:35.118803 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:35.119245 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:35.119712 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:35.223525 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:35.224194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:35.235499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:35.239794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:35.239794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:35.239794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:35.239794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:35.240313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:35.271746 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:35.280840 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-639c2397-8e00-4745-91a0-b54efe3eb90e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.174782 Aug 24 06:49:35.281472 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 483/940] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:35 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:35.397499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:35.407275 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:35.408897 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:35.410133 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b0e95aec-e963-4a3e-959b-3f6747660817 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.190846 Aug 24 06:49:35.410694 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 458/941] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:35 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:36.304419 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:36.304958 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:36.311532 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:36.312657 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:36.313471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:36.314232 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:36.314686 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:36.315107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:36.440575 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:36.441203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:36.447822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:36.448267 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:36.448736 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:36.449468 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:36.449928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:36.450296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:36.450428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:36.458396 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c96f576c-6edf-4461-8eab-762a7ca6eb04 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.158302 Aug 24 06:49:36.459232 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 484/942] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:36 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:36.587858 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:36.596651 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:36.598334 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:36.599407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-08742cf0-ebb4-47a9-8e26-eb8ac34a955f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.164286 Aug 24 06:49:36.600039 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 459/943] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:36 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:37.479613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:37.480206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:37.487031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:37.487508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:37.487936 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:37.488619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:37.489064 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:37.489510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:37.622144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:37.623007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:37.623624 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:37.629932 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:37.630244 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2a60718e-398a-4b23-8e3e-b9ddcccedd2a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.154572 Aug 24 06:49:37.630411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:37.630816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 485/944] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:37 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:37.630974 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:37.631523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:37.631971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:37.632389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:37.769042 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:37.777641 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:37.779169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:37.780354 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-64e64155-41e9-4d46-9b65-b663fae8eca9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.161408 Aug 24 06:49:37.781609 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 460/945] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:37 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:38.651008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:38.651664 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:38.653513 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:38.656188 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=6 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:38.660135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:38.660630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:38.661071 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:38.661857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:38.662309 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:38.662734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:38.804567 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:38.805162 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:38.807155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=6 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:38.809976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:38.812602 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:38.813268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:38.814460 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:38.815343 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:38.815811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:38.816243 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:38.818455 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7f4c376d-cd56-4f37-a3ba-e6cab70ce469 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.171279 Aug 24 06:49:38.820865 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 486/946] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:38 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:38.950132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:38.958909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:38.960149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:38.961370 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-30fae7cf-55b5-4a26-93fb-34bf286c4582 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.160846 Aug 24 06:49:38.961913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 461/947] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:38 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:39.840224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:39.840830 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:39.847948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:39.848434 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:39.848864 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:39.849593 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:39.850042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:39.850462 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:39.978041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:39.985045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:39.985703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:39.985828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-647a82a4-0e95-4528-91c9-a847b6c76dc3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.149427 Aug 24 06:49:39.986336 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 487/948] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:39 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:39.992229 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:39.992710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:39.993136 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:39.993849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:39.994292 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:39.994726 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:40.123295 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:40.132887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:40.136644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:40.136644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3bc7e6a8-4ffc-4e2f-9bda-847a385f0ce2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.154559 Aug 24 06:49:40.136644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 462/949] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:39 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:41.006714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:41.007313 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:41.013673 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:41.014153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:41.014589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:41.016037 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:41.016568 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:41.017023 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:41.154239 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:41.159413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:41.160092 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:41.163036 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2cf50dd5-59c9-43e3-aa52-0e786aeba41d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.160327 Aug 24 06:49:41.165547 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 488/950] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:41 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:41.166901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:41.167388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:41.167817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:41.168509 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:41.168953 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:41.169398 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:41.306626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:41.315833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:41.317821 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:41.318504 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3fe1fc36-11a7-4265-b29a-988e8bf8b633 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.164081 Aug 24 06:49:41.319068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 463/951] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:41 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:42.184134 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:42.185147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:42.191575 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:42.192057 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:42.192487 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:42.193175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:42.193645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:42.194061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:42.327145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:42.335793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-162d1102-5143-45b0-8536-e89aafb0c3c7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.155497 Aug 24 06:49:42.336401 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 489/952] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:42 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:42.342619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:42.344543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:42.351460 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:42.351938 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:42.352363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:42.353048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:42.353555 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:42.353973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:42.486467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:42.494840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:42.496346 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:42.497573 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2f7dbf8f-3a50-4e71-a1af-cd70a35aed7f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.158734 Aug 24 06:49:42.498142 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 464/953] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:42 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:43.357338 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:43.357946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:43.365086 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:43.365607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:43.366038 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:43.366748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:43.367196 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:43.367616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:43.495571 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:43.503213 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3c18ae4e-ac23-4f0e-8d47-cb5bc9f7f95d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.149763 Aug 24 06:49:43.503772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 490/954] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:43 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:43.519802 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:43.520406 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:43.526480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:43.526961 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:43.527399 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:43.528084 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:43.528536 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:43.528956 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:43.663269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:43.671938 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:43.673473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:43.674610 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cb90ce45-b7ed-4b07-92d2-1e377be03064 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.158716 Aug 24 06:49:43.675166 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 465/955] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:43 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:44.523457 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:44.524059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:44.530839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:44.531473 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:44.531906 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:44.532638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:44.533089 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:44.533539 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:44.697396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:44.698094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:44.705108 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:44.705645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:44.706081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:44.706786 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:44.707238 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:44.707658 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:44.844515 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:44.853248 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:44.854767 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:44.855952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c8ef5630-5aba-400e-ad96-4a029b560490 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.162681 Aug 24 06:49:44.856806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 466/956] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:44 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:44.905765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:44.913999 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4dd5666e-9be1-462d-9816-e98e3b3ab746 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.394381 Aug 24 06:49:44.916028 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 491/957] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:44 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:45.880361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:45.880962 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:45.887341 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:45.887815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:45.888244 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:45.888918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:45.889395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:45.890689 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:45.935610 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:45.936222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:45.939579 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:45.944183 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:45.944702 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:45.945135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:45.945853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:45.946303 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:45.946723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:46.024457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:46.033219 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:46.034759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:46.035952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-71f295cf-2244-4731-bff9-2f062ec983e5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.159477 Aug 24 06:49:46.036511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 467/958] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:45 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:46.077920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:46.086069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c4fdd093-10f2-4a6c-90bb-651a25be9dd7 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.154250 Aug 24 06:49:46.086632 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 492/959] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:45 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:46.882681 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-b087c051-a043-446c-bccb-38adbc4757db req-db8aa240-1365-4c0d-bf66-bdd3bf866c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48328e6b-2420-4a80-951c-5b3ec8b91c4d", "name": "network-vif-plugged", "status": "completed", "tag": "2ea9414b-1fc6-4f5d-98b4-e86ba17be292"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:46.893993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-b087c051-a043-446c-bccb-38adbc4757db req-db8aa240-1365-4c0d-bf66-bdd3bf866c72 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:46.894473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-b087c051-a043-446c-bccb-38adbc4757db req-db8aa240-1365-4c0d-bf66-bdd3bf866c72 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:46.894928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-b087c051-a043-446c-bccb-38adbc4757db req-db8aa240-1365-4c0d-bf66-bdd3bf866c72 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:46.907481 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-b087c051-a043-446c-bccb-38adbc4757db req-db8aa240-1365-4c0d-bf66-bdd3bf866c72 service nova] Creating event network-vif-plugged:2ea9414b-1fc6-4f5d-98b4-e86ba17be292 for instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d on hv-cinder-85427 Aug 24 06:49:46.912816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-b087c051-a043-446c-bccb-38adbc4757db req-db8aa240-1365-4c0d-bf66-bdd3bf866c72 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034148 Aug 24 06:49:46.913469 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 468/960] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:49:47.059307 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:47.059921 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:47.066674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:47.067161 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:47.067599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:47.068294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:47.068756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:47.069174 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:47.108835 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:47.109888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:47.116212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:47.116720 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:47.117163 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:47.118028 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:47.118492 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:47.118920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:47.219409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:47.223119 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:47.224836 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:47.226032 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-71c3e546-c8ab-42d1-998f-13d02b469a8d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.170716 Aug 24 06:49:47.226586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 493/961] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:47 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:47.265388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:47.273057 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8dce8771-b17f-4886-933e-d0325f9386d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.169092 Aug 24 06:49:47.273654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 469/962] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:47 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:48.249565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:48.250280 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:48.258087 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:48.258579 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:48.259017 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:48.259723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:48.260181 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:48.260604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:48.294772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:48.295392 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:48.302810 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:48.303297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:48.303739 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:48.304428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:48.304874 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:48.305319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:48.408966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:48.417782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:48.419279 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:48.420430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6569bd48-191b-4f31-823a-70779710cf6b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.175356 Aug 24 06:49:48.420995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 494/963] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:48 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:48.452683 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:48.460395 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d06c43a5-1fba-4c87-afd2-f58de3bd5258 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.169816 Aug 24 06:49:48.460960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 470/964] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:48 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:49.443658 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:49.444253 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:49.450656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:49.451127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:49.451556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:49.452864 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:49.453426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:49.453837 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:49.482493 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:49.483357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:49.490367 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:49.490852 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:49.491281 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:49.491976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:49.492426 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:49.492847 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:49.497211 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=100 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:49.594384 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:49.603935 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:49.604330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:49.605546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d2db542f-415e-4fcc-961c-81e2b8a35f9c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.165811 Aug 24 06:49:49.627282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 495/965] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:49 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:49.636319 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:49.644687 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-553d5bf6-7ea2-49cb-a3b9-bca1bc338519 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.165917 Aug 24 06:49:49.645641 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 471/966] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:49 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:50.628922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:50.629555 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:50.636186 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:50.636681 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:50.637121 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:50.637927 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:50.638383 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:50.638813 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:50.665784 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:50.666543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:50.673695 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:50.674185 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:50.674619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:50.675326 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:50.675783 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:50.676216 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:50.773504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:50.783045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:50.784549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:50.785748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-bd39a08a-2f14-443a-a157-a4e16718e91a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.160886 Aug 24 06:49:50.786304 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 496/967] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:50 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:50.810354 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:50.817875 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e4fd0ede-080f-498e-b6a5-bd0b51c82e0a tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.155857 Aug 24 06:49:50.818433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 472/968] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:50 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:51.808700 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:51.809310 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:51.817037 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:51.817579 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:51.818076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:51.818777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:51.819500 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:51.820160 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:51.841360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:51.842233 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:51.849096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:51.849759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:51.850400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:51.851182 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:51.851870 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:51.852371 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:51.966839 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:51.977169 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:51.978704 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:51.979949 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d1d9aef4-ac9a-460c-b30b-ee54655d6247 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.175491 Aug 24 06:49:51.980954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 497/969] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:51 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:51.987096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-f94b4346-8bf7-47db-93b7-b32c731362d9 req-b9208941-69d7-4ef1-ad74-8793a76dad91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391581a7-43ed-48fd-add7-cbc73108eae4", "name": "network-vif-plugged", "status": "completed", "tag": "0621de02-3d16-4e02-ac8f-b0ed8b589e93"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:51.998695 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:51.999762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-f94b4346-8bf7-47db-93b7-b32c731362d9 req-b9208941-69d7-4ef1-ad74-8793a76dad91 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:52.000317 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-f94b4346-8bf7-47db-93b7-b32c731362d9 req-b9208941-69d7-4ef1-ad74-8793a76dad91 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:52.000751 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-f94b4346-8bf7-47db-93b7-b32c731362d9 req-b9208941-69d7-4ef1-ad74-8793a76dad91 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:52.004930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:52.008211 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d9acf24f-973a-4327-8fd7-020a2b34b3cf tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.171995 Aug 24 06:49:52.009590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 473/970] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:51 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:52.012767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-f94b4346-8bf7-47db-93b7-b32c731362d9 req-b9208941-69d7-4ef1-ad74-8793a76dad91 service nova] Creating event network-vif-plugged:0621de02-3d16-4e02-ac8f-b0ed8b589e93 for instance 391581a7-43ed-48fd-add7-cbc73108eae4 on hv-cinder-85427 Aug 24 06:49:52.018755 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-f94b4346-8bf7-47db-93b7-b32c731362d9 req-b9208941-69d7-4ef1-ad74-8793a76dad91 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036617 Aug 24 06:49:52.019366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 498/971] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:53.003802 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:53.004410 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:53.010951 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:53.011430 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:53.011866 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:53.012550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:53.013012 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:53.013459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:53.037000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:53.037725 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:53.045042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:53.045573 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:53.046510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:53.047415 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:53.047878 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:53.048304 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:53.145085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:53.153373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:53.154966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:53.156631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-96f90c71-73c0-4ee4-9ac9-ac16d3b4a155 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.157818 Aug 24 06:49:53.157239 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 474/972] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:52 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:53.187520 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:53.195643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-601b8067-67b1-4c7f-82a2-2f729cdec5d9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.163441 Aug 24 06:49:53.196191 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 499/973] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:53 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:54.180912 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:54.181580 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:54.189999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:54.190459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:54.190902 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:54.191605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:54.192115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:54.192595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:54.220601 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:54.221772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:54.232301 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:54.233065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:54.233874 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:54.235016 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:54.235762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:54.236494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:54.412167 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:54.421441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a6709e27-da17-4f73-b5af-0256c733f5ca tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1366 microversion: 2.1 time: 0.207278 Aug 24 06:49:54.422194 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 500/974] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:54 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:54.596665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:54.605262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:54.606786 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:54.607954 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e1fb362a-50cc-4d23-b617-a79886bc34d4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1744 microversion: 2.20 time: 0.431229 Aug 24 06:49:54.609089 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 475/975] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:54 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1744 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:55.446965 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:55.450444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:55.454799 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.455288 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.455722 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.456421 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.456872 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.457395 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.598360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:55.606091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-70121c70-6b4c-46e7-aff4-e14fca5155f3 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1557 microversion: 2.1 time: 0.163023 Aug 24 06:49:55.606653 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 501/976] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:55 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:55.627478 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-688c8c2e-cccd-465c-8cbf-4c9289eeea2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:55.629976 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-688c8c2e-cccd-465c-8cbf-4c9289eeea2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:55.631451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:55.632061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:55.634509 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-688c8c2e-cccd-465c-8cbf-4c9289eeea2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.634995 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-688c8c2e-cccd-465c-8cbf-4c9289eeea2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.635430 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-688c8c2e-cccd-465c-8cbf-4c9289eeea2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.637729 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-688c8c2e-cccd-465c-8cbf-4c9289eeea2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.638161 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.638394 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-688c8c2e-cccd-465c-8cbf-4c9289eeea2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.638960 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.639286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-688c8c2e-cccd-465c-8cbf-4c9289eeea2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.640399 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.641330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.641946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.642832 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.735372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-688c8c2e-cccd-465c-8cbf-4c9289eeea2b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112768 Aug 24 06:49:55.736017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 476/977] 10.222.0.47 () {58 vars in 1275 bytes} [Wed Aug 24 06:49:55 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:55.790450 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:55.800590 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:55.802287 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:55.803470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4acf05b5-3f0f-4d7c-9db8-06fc4c5bb2f0 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.176109 Aug 24 06:49:55.804185 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 502/978] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:55 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:56.827396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-84f03abe-ef67-4e2a-9e59-b97ff038c42c req-fff2f07e-fb12-496b-9c67-b0b5899990d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48328e6b-2420-4a80-951c-5b3ec8b91c4d", "tag": "2ea9414b-1fc6-4f5d-98b4-e86ba17be292"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:56.828485 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:56.829105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:56.840035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:56.840531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:56.840970 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:56.841707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:56.842155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:56.842753 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:56.849933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-84f03abe-ef67-4e2a-9e59-b97ff038c42c req-fff2f07e-fb12-496b-9c67-b0b5899990d2 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:56.850764 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-84f03abe-ef67-4e2a-9e59-b97ff038c42c req-fff2f07e-fb12-496b-9c67-b0b5899990d2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:56.851426 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-84f03abe-ef67-4e2a-9e59-b97ff038c42c req-fff2f07e-fb12-496b-9c67-b0b5899990d2 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:56.867213 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-84f03abe-ef67-4e2a-9e59-b97ff038c42c req-fff2f07e-fb12-496b-9c67-b0b5899990d2 service nova] Creating event network-changed:2ea9414b-1fc6-4f5d-98b4-e86ba17be292 for instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d on hv-cinder-85427 Aug 24 06:49:56.874421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-84f03abe-ef67-4e2a-9e59-b97ff038c42c req-fff2f07e-fb12-496b-9c67-b0b5899990d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053335 Aug 24 06:49:56.877584 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 477/979] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:57.041806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:57.054285 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:57.057148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:57.059242 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ef67092a-d9a5-49d1-8a5b-3bddc8da23f2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.235422 Aug 24 06:49:57.060764 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 503/980] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:56 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:58.090393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:58.091685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:58.099402 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.099836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.100285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.100991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.101499 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.101949 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.275335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:58.284057 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:58.285669 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:58.286829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8794a0ac-dc07-4c74-a530-35b043d0b2b6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.201438 Aug 24 06:49:58.287380 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 478/981] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:58 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:59.313397 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:59.313990 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:59.321772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.322264 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.322698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.323394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.323845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.324290 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.478728 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:59.487224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:59.488767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:59.490000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2cc6d8ca-3a4a-4d06-ac6e-e836c3ab00a1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.183581 Aug 24 06:49:59.490554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 504/982] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:59 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:00.499526 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d819fee5-a5fb-4bf2-85af-cf57383dac11 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:00.500050 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d819fee5-a5fb-4bf2-85af-cf57383dac11 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:00.506716 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d819fee5-a5fb-4bf2-85af-cf57383dac11 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:00.508882 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d819fee5-a5fb-4bf2-85af-cf57383dac11 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:00.509318 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d819fee5-a5fb-4bf2-85af-cf57383dac11 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:00.510044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d819fee5-a5fb-4bf2-85af-cf57383dac11 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:00.510507 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d819fee5-a5fb-4bf2-85af-cf57383dac11 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:00.515125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d819fee5-a5fb-4bf2-85af-cf57383dac11 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:00.515322 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:00.516379 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:00.523522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:00.524008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:00.524648 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:00.525582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:00.526035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:00.526982 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:00.544486 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d819fee5-a5fb-4bf2-85af-cf57383dac11 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/ips" status: 200 len: 146 microversion: 2.1 time: 0.048943 Aug 24 06:50:00.552880 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 479/983] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:50:00 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/ips => generated 146 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:00.697540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:00.707456 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:00.709226 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:00.712047 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-21740677-ac95-4606-b660-16b6b5e20337 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.201378 Aug 24 06:50:00.713838 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 505/984] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:00 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:01.034754 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-705009656", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1329256554", "security_groups": [{"name": "tempest-secgroup-smoke-1486398605"}], "block_device_mapping_v2": [{"uuid": "768c4656-eff6-4859-933f-58fc8143c77d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "27d7c166-db17-4e73-a5c2-606d6229bd9b"}]}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:01.178215 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] validate_networks() for [('27d7c166-db17-4e73-a5c2-606d6229bd9b', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:50:01.621142 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:50:01.621743 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:50:01.622286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:50:01.622674 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:50:01.623086 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:50:01.626095 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=58 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:01.633908 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:01.634335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:01.634770 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:01.635489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:01.635942 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:01.636365 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:01.656824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Getting quotas for project a97277d100304d6aa689f73174562474. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:50:01.661890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Getting quotas for user 594e9324c44540568a81fd5fdb980efb and project a97277d100304d6aa689f73174562474. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:50:01.739557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:01.740415 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:01.748782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:01.749698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:01.749698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:01.755109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:01.760390 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:01.760390 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:01.760623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:50:01.763258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='768c4656-eff6-4859-933f-58fc8143c77d',volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:50:01.977463 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:01.989465 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:01.991181 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:01.992616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0746db28-b072-4874-bf5b-a874893a0632 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.256968 Aug 24 06:50:01.993777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 506/985] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:01 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:50:02.325608 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-dd665a37-36cd-46e7-aac9-506f9f4482bd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.294878 Aug 24 06:50:02.340823 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c01be7d4-641a-4201-864d-46a79debee69 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:02.341460 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c01be7d4-641a-4201-864d-46a79debee69 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:02.353366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 480/986] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:50:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:50:02.411097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c01be7d4-641a-4201-864d-46a79debee69 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:02.423597 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c01be7d4-641a-4201-864d-46a79debee69 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1094 microversion: 2.1 time: 0.088865 Aug 24 06:50:02.426140 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 507/987] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:02 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:02.888384 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-26fb918b-b424-480d-b764-3d414bb83ca1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "852d3ce8-204e-47d8-924a-7af134afca5d"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:02.891892 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-26fb918b-b424-480d-b764-3d414bb83ca1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:02.899791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26fb918b-b424-480d-b764-3d414bb83ca1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:02.900606 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26fb918b-b424-480d-b764-3d414bb83ca1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:02.901713 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26fb918b-b424-480d-b764-3d414bb83ca1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:02.902521 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26fb918b-b424-480d-b764-3d414bb83ca1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:02.903135 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26fb918b-b424-480d-b764-3d414bb83ca1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:02.903644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-26fb918b-b424-480d-b764-3d414bb83ca1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.018646 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:03.019921 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:03.042460 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:03.042960 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:03.044092 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.047588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:03.052382 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:03.052382 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.231021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:03.240699 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:03.242327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:03.244264 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d9b22d89-cbfe-45f3-97b6-955cd99f6705 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.231648 Aug 24 06:50:03.245012 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 508/988] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:03 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:03.451449 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:03.453129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:03.472739 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:03.473690 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:03.474330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.474805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:03.475316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:03.475909 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.574179 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:03.583830 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-108c23ea-d823-48df-9a89-c3124917ccd6 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1144 microversion: 2.1 time: 0.141060 Aug 24 06:50:03.589377 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 509/989] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:03 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1144 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:03.881322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-26fb918b-b424-480d-b764-3d414bb83ca1 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.998188 Aug 24 06:50:03.888576 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 481/990] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:50:02 2022] POST /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments => generated 194 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:04.270370 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:04.271154 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:04.279190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.280990 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.281845 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.283070 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.283921 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.288561 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.455310 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:04.469693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:04.472108 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:04.474101 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-07b17b51-4656-4217-bf6f-6d142d1f4da4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.207730 Aug 24 06:50:04.474732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 510/991] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:04 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:50:04.611175 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:04.612819 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:04.622599 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.623290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.624181 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.626131 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.635809 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.645829 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.730450 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:04.739475 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3caf713d-06c0-4931-9fc8-ca954f813433 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1200 microversion: 2.1 time: 0.133620 Aug 24 06:50:04.753672 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 482/992] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:04 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1200 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:50:05.500784 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:05.501337 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:05.508469 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:05.509411 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:05.509882 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:05.510649 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:05.511124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:05.511596 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:05.672544 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:05.681215 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:05.682729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:05.683883 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c78217db-2e6e-4af5-9b2a-5e6adf428c08 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.188262 Aug 24 06:50:05.684447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 511/993] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:05 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:05.766807 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:05.766807 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:05.773497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:05.773990 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:05.774404 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:05.775096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:05.775537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:05.776008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:06.001921 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:06.011963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-97c2f48d-90ef-44f7-b6dc-4142d4e3b754 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1278 microversion: 2.1 time: 0.250874 Aug 24 06:50:06.012814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 483/994] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:05 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:06.714356 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:06.715757 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:06.726573 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:06.727606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:06.728400 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:06.729352 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:06.730017 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:06.730931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:06.915573 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:06.927130 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:06.928606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:06.929813 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ae31dd1e-7c0a-4846-8187-f4558420d0cc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.220531 Aug 24 06:50:06.930687 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 512/995] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:06 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:07.043940 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:07.045128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:07.058500 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:07.064595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:07.064595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:07.064595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:07.064595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:07.065065 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:07.304346 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:07.314099 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1358763a-ae90-47d7-87a6-9c97f405dbed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1278 microversion: 2.1 time: 0.275273 Aug 24 06:50:07.329646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 484/996] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:07 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:50:07.368943 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-23e2b7c1-171a-4c2e-a095-733715a1bdf3 req-cf863098-98c2-4067-9106-828d02f380be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c89f8cf-aaa8-43d8-b632-88ecd0690a8a", "tag": "bc6fe70d-98e9-4938-bfac-e7e933f3b282"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:07.380173 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-23e2b7c1-171a-4c2e-a095-733715a1bdf3 req-cf863098-98c2-4067-9106-828d02f380be service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:07.380944 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-23e2b7c1-171a-4c2e-a095-733715a1bdf3 req-cf863098-98c2-4067-9106-828d02f380be service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:07.381552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-23e2b7c1-171a-4c2e-a095-733715a1bdf3 req-cf863098-98c2-4067-9106-828d02f380be service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:07.394561 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-23e2b7c1-171a-4c2e-a095-733715a1bdf3 req-cf863098-98c2-4067-9106-828d02f380be service nova] Creating event network-changed:bc6fe70d-98e9-4938-bfac-e7e933f3b282 for instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a on hv-cinder-85427 Aug 24 06:50:07.400470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-23e2b7c1-171a-4c2e-a095-733715a1bdf3 req-cf863098-98c2-4067-9106-828d02f380be service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034909 Aug 24 06:50:07.401302 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 513/997] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:07.967781 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:07.969128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:07.978224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:07.978725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:07.979171 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:07.979918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:07.980484 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:07.980948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:08.164348 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:08.167568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:08.169387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:08.171697 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-de1d937e-0529-4346-8c29-014fb77119d6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.208067 Aug 24 06:50:08.172522 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 485/998] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:07 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:08.337934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:08.339260 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:08.346814 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:08.347410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:08.347931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:08.348729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:08.349436 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:08.349974 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:08.512767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:08.522016 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-bd3af9ef-1ef4-421c-9b27-d33951206a13 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1278 microversion: 2.1 time: 0.188305 Aug 24 06:50:08.522625 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 514/999] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:08 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:50:09.197596 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:09.198835 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:09.206447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.207224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.207862 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.208639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.209094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.209564 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.377433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:09.390497 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:09.394094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:09.394094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a7ec9308-14b2-4796-b44e-70e1da653665 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.199885 Aug 24 06:50:09.394094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 486/1000] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:09 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:09.544014 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:09.544586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:09.552308 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.552797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.553253 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.553967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.554415 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.554834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.706078 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:09.713826 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5795f82b-3a80-4ad4-8ca5-3d9e52afedb0 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1278 microversion: 2.1 time: 0.173874 Aug 24 06:50:09.714452 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 515/1001] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:09 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:10.416568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:10.417163 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:10.427242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:10.427242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:10.427242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:10.427242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:10.427613 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:10.427613 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:10.653451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:10.671072 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:10.672610 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:10.673815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f7fc63b6-7ccd-443e-b285-6a7bd8e6ec36 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.261257 Aug 24 06:50:10.674418 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 487/1002] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:10 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:10.735308 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:10.736027 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:10.743467 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:10.743949 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:10.744467 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:10.745173 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:10.745643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:10.746064 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:10.887470 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:10.895786 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-166c5a52-06a7-4e7a-a30e-e72398b022a3 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1278 microversion: 2.1 time: 0.164523 Aug 24 06:50:10.896354 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 516/1003] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:10 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:11.697361 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:11.698140 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:11.700393 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:11.701104 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=6 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:11.706241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:11.706742 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:11.707208 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:11.707890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:11.708337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:11.708798 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:11.728179 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:11.854375 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:11.863310 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:11.864822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:11.866020 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2baab396-847c-4556-961e-729aa6afec6a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1739 microversion: 2.20 time: 0.172802 Aug 24 06:50:11.866631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 488/1004] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:11 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:11.916115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:11.916748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:11.923978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:11.924471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:11.924911 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:11.925647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:11.926100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:11.926526 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:11.932806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:12.064003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:12.071589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7e567d56-596a-43d3-9479-b91435b1deab tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1278 microversion: 2.1 time: 0.159446 Aug 24 06:50:12.072149 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 517/1005] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:11 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:12.891479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:12.892123 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:12.899132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:12.899728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:12.900253 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:12.900875 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:12.901368 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:12.901790 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:13.093989 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:13.094624 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:13.097024 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:13.102875 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:13.103489 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:13.103928 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:13.104656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:13.105112 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:13.105584 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:13.211397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:13.223347 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:13.230631 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:13.232904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8dce3998-0c52-4a35-9f58-29a9ad4aad95 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1721 microversion: 2.20 time: 0.345575 Aug 24 06:50:13.233541 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 489/1006] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:12 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1721 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:13.266362 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:13.278178 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-abb43500-5072-4013-a5aa-81aea88682ba tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1278 microversion: 2.1 time: 0.188156 Aug 24 06:50:13.292242 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 518/1007] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:13 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:13.739235 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5931c042-46bc-4532-84c1-b3730f6e2284 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:13.741531 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5931c042-46bc-4532-84c1-b3730f6e2284 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:13.747449 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5931c042-46bc-4532-84c1-b3730f6e2284 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:13.750696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5931c042-46bc-4532-84c1-b3730f6e2284 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:13.750696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5931c042-46bc-4532-84c1-b3730f6e2284 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:13.750696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5931c042-46bc-4532-84c1-b3730f6e2284 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:13.750696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5931c042-46bc-4532-84c1-b3730f6e2284 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:13.751128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5931c042-46bc-4532-84c1-b3730f6e2284 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:13.780091 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5931c042-46bc-4532-84c1-b3730f6e2284 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045713 Aug 24 06:50:13.780648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 490/1008] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:50:13 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:13.792206 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ad075a6f-3dbc-4220-a909-9ac0f9538798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:13.792780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ad075a6f-3dbc-4220-a909-9ac0f9538798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:13.799888 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad075a6f-3dbc-4220-a909-9ac0f9538798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:13.800374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad075a6f-3dbc-4220-a909-9ac0f9538798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:13.800808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad075a6f-3dbc-4220-a909-9ac0f9538798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:13.801549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad075a6f-3dbc-4220-a909-9ac0f9538798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:13.802001 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad075a6f-3dbc-4220-a909-9ac0f9538798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:13.802433 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ad075a6f-3dbc-4220-a909-9ac0f9538798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:13.832945 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ad075a6f-3dbc-4220-a909-9ac0f9538798 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/852d3ce8-204e-47d8-924a-7af134afca5d" status: 200 len: 194 microversion: 2.1 time: 0.044713 Aug 24 06:50:13.833488 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 519/1009] 10.222.0.47 () {58 vars in 1413 bytes} [Wed Aug 24 06:50:13 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/852d3ce8-204e-47d8-924a-7af134afca5d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:14.258946 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:14.259558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:14.266054 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:14.266539 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:14.266975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:14.268459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:14.269040 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:14.269795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:14.299452 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:14.300161 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:14.307036 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:14.310709 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:14.310709 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:14.310709 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:14.310709 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:14.311266 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:14.427384 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:14.435853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:14.437452 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:14.438613 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b350c3f1-4710-48d2-9da3-f404d7b11034 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1721 microversion: 2.20 time: 0.183582 Aug 24 06:50:14.439173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 491/1010] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:14 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:14.465112 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:14.474766 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7e08384c-5d62-4e08-8e1f-2b4b8b92a062 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1278 microversion: 2.1 time: 0.179328 Aug 24 06:50:14.475380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 520/1011] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:14 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:50:15.462536 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:15.466400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:15.474038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.474523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.474948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.475636 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.476483 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.476920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.496917 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-eaf6a8ee-cc26-41bf-974e-fd79c8bf3767 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "911e78f9-5f8d-48b2-a124-8dcf216ee454"}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:15.503794 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-eaf6a8ee-cc26-41bf-974e-fd79c8bf3767 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:15.506749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eaf6a8ee-cc26-41bf-974e-fd79c8bf3767 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.507465 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eaf6a8ee-cc26-41bf-974e-fd79c8bf3767 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.508042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eaf6a8ee-cc26-41bf-974e-fd79c8bf3767 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.508777 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eaf6a8ee-cc26-41bf-974e-fd79c8bf3767 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.509269 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eaf6a8ee-cc26-41bf-974e-fd79c8bf3767 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.509706 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eaf6a8ee-cc26-41bf-974e-fd79c8bf3767 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.623439 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:15.638262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:15.639993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:15.641199 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9e903968-9117-446d-b464-3eaca6f29549 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1721 microversion: 2.20 time: 0.182675 Aug 24 06:50:15.642259 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 492/1012] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:15 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:15.648065 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:15.648669 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:15.656017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.656852 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.658931 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.660055 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.664186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.664186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.815853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:15.816873 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c3673dc3-3f03-4730-a4ff-1396087f0128 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1278 microversion: 2.1 time: 0.172126 Aug 24 06:50:15.817472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 493/1013] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:15 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:16.106788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-f8629327-33a1-47e1-bf70-d78fbaefc85f req-fea4c523-57d3-4061-8090-d6014a9f2456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391581a7-43ed-48fd-add7-cbc73108eae4", "name": "network-vif-unplugged", "status": "completed", "tag": "0621de02-3d16-4e02-ac8f-b0ed8b589e93"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:16.118941 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-f8629327-33a1-47e1-bf70-d78fbaefc85f req-fea4c523-57d3-4061-8090-d6014a9f2456 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.119782 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-f8629327-33a1-47e1-bf70-d78fbaefc85f req-fea4c523-57d3-4061-8090-d6014a9f2456 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.120212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-f8629327-33a1-47e1-bf70-d78fbaefc85f req-fea4c523-57d3-4061-8090-d6014a9f2456 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.132819 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-f8629327-33a1-47e1-bf70-d78fbaefc85f req-fea4c523-57d3-4061-8090-d6014a9f2456 service nova] Creating event network-vif-unplugged:0621de02-3d16-4e02-ac8f-b0ed8b589e93 for instance 391581a7-43ed-48fd-add7-cbc73108eae4 on hv-cinder-85427 Aug 24 06:50:16.138048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-f8629327-33a1-47e1-bf70-d78fbaefc85f req-fea4c523-57d3-4061-8090-d6014a9f2456 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034999 Aug 24 06:50:16.138771 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 494/1014] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:16.400477 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-eaf6a8ee-cc26-41bf-974e-fd79c8bf3767 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "POST /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.907452 Aug 24 06:50:16.401072 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 521/1015] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:50:15 2022] POST /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:50:16.665293 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:16.666013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:16.672366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.672841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.673296 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.674215 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.674685 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.675165 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.814649 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:16.819914 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:16.821451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:16.822657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e6945f82-9f36-486c-8544-3e189c4dbfa4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1724 microversion: 2.20 time: 0.162084 Aug 24 06:50:16.823196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 495/1016] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:16 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:16.838231 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:16.838987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:16.841446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=62 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:16.847463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2d108736-267e-4e35-9218-0b4f2ad983f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4b33365-a86d-481d-8244-270a12cc1a36"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:16.847703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.848300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.848640 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.849358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.849808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.854433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2d108736-267e-4e35-9218-0b4f2ad983f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:16.854557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.856072 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d108736-267e-4e35-9218-0b4f2ad983f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.856560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d108736-267e-4e35-9218-0b4f2ad983f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.857022 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d108736-267e-4e35-9218-0b4f2ad983f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.857746 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d108736-267e-4e35-9218-0b4f2ad983f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.858194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d108736-267e-4e35-9218-0b4f2ad983f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.858612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d108736-267e-4e35-9218-0b4f2ad983f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:17.027399 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:17.039223 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8566df4b-a01e-47ec-ad60-78d4c3ee568f tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.204889 Aug 24 06:50:17.040020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 522/1017] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:16 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:18.065033 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:18.065986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:18.072026 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:18.072497 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:18.072924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:18.073655 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:18.074094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:18.074510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:18.146162 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2d108736-267e-4e35-9218-0b4f2ad983f9 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.303526 Aug 24 06:50:18.146780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 496/1018] 10.222.0.47 () {62 vars in 1364 bytes} [Wed Aug 24 06:50:16 2022] POST /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/os-volume_attachments => generated 188 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:50:18.230312 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:18.230312 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2c4ba9b5-2c22-423e-aad1-b83c7ba9e7f1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.164568 Aug 24 06:50:18.230312 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 523/1019] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:18 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:18.276744 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2001cab5-00e7-4449-a32b-bbde6d4b5050 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:18.277259 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2001cab5-00e7-4449-a32b-bbde6d4b5050 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:18.284445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2001cab5-00e7-4449-a32b-bbde6d4b5050 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:18.284925 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2001cab5-00e7-4449-a32b-bbde6d4b5050 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:18.285463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2001cab5-00e7-4449-a32b-bbde6d4b5050 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:18.286191 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2001cab5-00e7-4449-a32b-bbde6d4b5050 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:18.286633 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2001cab5-00e7-4449-a32b-bbde6d4b5050 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:18.287048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2001cab5-00e7-4449-a32b-bbde6d4b5050 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:18.931703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2001cab5-00e7-4449-a32b-bbde6d4b5050 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "DELETE /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/os-volume_attachments/a4b33365-a86d-481d-8244-270a12cc1a36" status: 202 len: 0 microversion: 2.20 time: 0.659026 Aug 24 06:50:18.932581 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 497/1020] 10.222.0.47 () {60 vars in 1457 bytes} [Wed Aug 24 06:50:18 2022] DELETE /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/os-volume_attachments/a4b33365-a86d-481d-8244-270a12cc1a36 => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:50:18.996240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:18.996832 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:19.003808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.004681 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.005489 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.006732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.007552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.008269 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.054602 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127727) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 06:50:19.254508 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:19.255125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:19.261034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.261577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.261947 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.262635 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.263081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.263494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.383673 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-02c439db-7c82-4830-a3c5-8fc280032bfa tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "POST /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/action" status: 202 len: 0 microversion: 2.20 time: 0.390894 Aug 24 06:50:19.384527 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 524/1021] 10.222.0.47 () {62 vars in 1319 bytes} [Wed Aug 24 06:50:18 2022] POST /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:50:19.395693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:19.396094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:19.402535 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.403129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.403600 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.404348 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.404985 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.405118 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:19.406145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.414814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-511fc7c7-4c76-4c6c-ab21-aaa1ec5261ed tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.171488 Aug 24 06:50:19.417240 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 498/1022] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:19 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:50:19.551311 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:19.560446 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:19.561973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:19.567171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2a537f6e-ce2e-4ecc-a33c-da981ea36260 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1672 microversion: 2.20 time: 0.174470 Aug 24 06:50:19.567171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 525/1023] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:19 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:20.439079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:20.439079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:20.444513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:20.444997 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:20.445917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:20.446943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:20.447587 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:20.448011 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:20.592406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:20.594392 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:20.604220 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:20.604898 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:20.605902 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:20.606943 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:20.607546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:20.608240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:20.608612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:20.620704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5d45429f-8e8c-49c7-8c54-4dbdb1498564 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.186829 Aug 24 06:50:20.620704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 499/1024] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:20 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:20.796320 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:20.806005 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:20.807495 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:20.808785 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-142d768a-143d-4e92-b763-e2451c837354 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1672 microversion: 2.20 time: 0.224435 Aug 24 06:50:20.809424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 526/1025] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:20 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1672 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:21.638483 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:21.639088 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:21.646103 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:21.646585 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:21.647017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:21.647709 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:21.648161 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:21.648585 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:21.809550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:21.812933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:21.819694 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3693bce4-463b-47f6-aaee-e7f149ba2c1a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.185053 Aug 24 06:50:21.823008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 500/1026] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:21 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:21.832377 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:21.832971 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:21.838871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:21.839336 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:21.839796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:21.840865 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:21.841331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:21.841756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:21.978765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:21.986990 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:21.988715 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:21.989901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9094d8fc-6c4d-4a24-8ce7-d41649bc048d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.162031 Aug 24 06:50:21.990452 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 527/1027] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:21 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:22.840999 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:22.842177 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:22.850039 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:22.850521 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:22.851129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:22.851826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:22.852273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:22.852683 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:22.992358 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:23.000058 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3f32c4cb-6d37-4ea2-acb9-56d9267d5f0e tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.163168 Aug 24 06:50:23.000621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 501/1028] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:22 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:23.013203 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:23.013924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:23.020797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:23.021575 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:23.022019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:23.022719 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:23.023182 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:23.023607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:23.160135 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:23.168714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:23.170449 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:23.171606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-38e7ece5-7a07-45c2-af2e-a407b5486ecc tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.162490 Aug 24 06:50:23.172153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 528/1029] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:23 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:24.024411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:24.025692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:24.032420 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:24.032907 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:24.033423 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:24.034550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:24.035011 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:24.035436 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:24.176427 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:24.184559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a5263300-4578-4191-8ead-d694b14d872d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.166598 Aug 24 06:50:24.185380 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 502/1030] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:24 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:24.196116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:24.197538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:24.204536 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:24.205885 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:24.206821 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:24.208461 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:24.209363 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:24.210400 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:24.353021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:24.361350 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:24.363064 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:24.364228 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-457bd241-8d2f-4f00-9ec9-e15d1b76c5f8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.172099 Aug 24 06:50:24.364788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 529/1031] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:24 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:25.276580 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:25.277228 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:25.287920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.287920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.287920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.287920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.289173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.289173 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.339640 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-256a0e6c-fbfd-43b6-a5d0-c6d6e814fa6e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:25.342062 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-256a0e6c-fbfd-43b6-a5d0-c6d6e814fa6e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:25.349958 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-256a0e6c-fbfd-43b6-a5d0-c6d6e814fa6e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.350430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-256a0e6c-fbfd-43b6-a5d0-c6d6e814fa6e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.350865 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-256a0e6c-fbfd-43b6-a5d0-c6d6e814fa6e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.351564 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-256a0e6c-fbfd-43b6-a5d0-c6d6e814fa6e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.352013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-256a0e6c-fbfd-43b6-a5d0-c6d6e814fa6e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.352429 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-256a0e6c-fbfd-43b6-a5d0-c6d6e814fa6e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.399048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-256a0e6c-fbfd-43b6-a5d0-c6d6e814fa6e tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063725 Aug 24 06:50:25.399806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 530/1032] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:50:25 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:25.410315 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:25.410923 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:25.416991 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.417595 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.418068 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.418774 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.419201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.419799 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.442050 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:25.448595 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:25.450337 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ad808da2-84b6-4e76-be2b-aea0612153b4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.179236 Aug 24 06:50:25.451194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 503/1033] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:25 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:25.546147 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-63814077-5f68-4dbf-b9a5-7855b16bf31c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:25.546884 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-63814077-5f68-4dbf-b9a5-7855b16bf31c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:25.554297 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63814077-5f68-4dbf-b9a5-7855b16bf31c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.554930 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63814077-5f68-4dbf-b9a5-7855b16bf31c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.555455 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63814077-5f68-4dbf-b9a5-7855b16bf31c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.556224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63814077-5f68-4dbf-b9a5-7855b16bf31c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.556774 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63814077-5f68-4dbf-b9a5-7855b16bf31c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.557291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-63814077-5f68-4dbf-b9a5-7855b16bf31c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.587303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-63814077-5f68-4dbf-b9a5-7855b16bf31c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/852d3ce8-204e-47d8-924a-7af134afca5d" status: 200 len: 194 microversion: 2.1 time: 0.045927 Aug 24 06:50:25.587905 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 504/1034] 10.222.0.47 () {58 vars in 1413 bytes} [Wed Aug 24 06:50:25 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/852d3ce8-204e-47d8-924a-7af134afca5d => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:25.594605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:25.599705 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:25.600233 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:25.604436 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:25.606065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:25.606389 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.606867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.607223 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-21133517-c310-4324-9067-b328453ea66a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.206332 Aug 24 06:50:25.607341 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.607779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 531/1035] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:25 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:25.607959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:25.608407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:25.608826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:25.692902 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lazy-loading 'services' on Instance uuid 03e77cd4-6087-440c-b857-1dc22f18eb4f {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:50:25.923017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-dd6e2bf5-bd99-4739-bb5a-bb2200c56883 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "DELETE /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/852d3ce8-204e-47d8-924a-7af134afca5d" status: 202 len: 0 microversion: 2.1 time: 0.326013 Aug 24 06:50:25.923857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 505/1036] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:50:25 2022] DELETE /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/852d3ce8-204e-47d8-924a-7af134afca5d => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:50:26.485807 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:26.487097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:26.495043 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:26.495686 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:26.496261 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:26.498107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:26.498805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:26.499747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:26.633719 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:26.634426 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:26.648208 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:26.648711 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:26.649156 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:26.649901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:26.650358 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:26.650907 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:26.654434 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:26.665029 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b7367c8a-a789-40ec-8cf3-f871ef893fac tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.182748 Aug 24 06:50:26.666070 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 532/1037] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:26 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:26.816153 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:26.824728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:26.826275 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:26.827452 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-097c815d-ad56-4429-9ee8-17ed73435916 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.198644 Aug 24 06:50:26.828009 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 506/1038] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:26 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:27.687411 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:27.688024 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:27.694978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:27.695453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:27.695891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:27.696595 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:27.697083 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:27.697538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:27.832822 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:27.840586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d1d7aa8f-f98b-4a34-912d-ff4dce05820c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.157145 Aug 24 06:50:27.841141 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 533/1039] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:27 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:27.851771 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:27.852380 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:27.858826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:27.859437 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:27.859870 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:27.860552 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:27.860993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:27.861437 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:27.992759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:28.001008 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:28.002553 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:28.003713 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a95cf643-8a7a-4f19-a6bd-647dc403f442 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.155946 Aug 24 06:50:28.004290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 507/1040] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:27 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:28.863153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:28.863962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:28.870641 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:28.871117 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:28.871567 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:28.872250 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:28.872703 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:28.873108 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:29.006977 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:29.016102 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d8d2540f-15e7-40fa-8ff9-1a5dba2c9e10 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.157269 Aug 24 06:50:29.016669 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 534/1041] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:28 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:29.026547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:29.027200 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:29.033734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:29.034756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:29.035206 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:29.036079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:29.036530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:29.036955 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:29.169991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:29.178078 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:29.179577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:29.180731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5dacb9e5-1bdd-499e-afae-7e262994e3c6 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.158149 Aug 24 06:50:29.181304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 508/1042] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:29 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:30.037263 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:30.037905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:30.045299 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:30.045806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:30.046336 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:30.047133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:30.047907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:30.048156 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:30.204790 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:30.205996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:30.207469 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:30.216020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b9a164d8-dec8-4064-9141-c9162e542d55 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.183567 Aug 24 06:50:30.217093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:30.220211 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:30.221384 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:30.226763 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:30.227616 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:30.230221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:30.233395 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 535/1043] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:30 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:30.423271 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:30.437444 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:30.439906 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:30.442034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c3a5d269-808f-4cd6-a4ae-8ac0d1271d32 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.241698 Aug 24 06:50:30.442669 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 509/1044] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:30 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:31.239813 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:31.240340 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:31.246802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:31.247280 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:31.247713 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:31.248414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:31.249075 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:31.249296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:31.383150 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:31.391013 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5cad5028-df8d-4beb-ad53-0934dfa27ece tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.155368 Aug 24 06:50:31.391736 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 536/1045] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:31 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:31.466043 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:31.466652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:31.473749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:31.474231 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:31.474666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:31.475388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:31.475842 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:31.476266 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:31.766384 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:31.775341 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:31.776963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:31.778176 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8153bf15-40de-40f3-864b-78eec19f8270 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.316135 Aug 24 06:50:31.779243 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 510/1046] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:31 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:32.411959 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:32.412553 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:32.418940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:32.419407 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:32.419829 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:32.420504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:32.420948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:32.421397 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:32.604807 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:32.613219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5f2e56e4-7377-4f01-ac66-52338925cb5d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.204531 Aug 24 06:50:32.613782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 537/1047] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:32 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:32.802448 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:32.803282 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:32.805796 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:32.810458 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:32.810914 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:32.811388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:32.812064 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:32.812507 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:32.812923 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:32.949530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:32.958119 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:32.959619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:32.960771 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9a34ff07-f953-44af-8739-78d50f939291 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.162977 Aug 24 06:50:32.961344 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 511/1048] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:32 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:33.634905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:33.635541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:33.642097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:33.642579 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:33.643009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:33.644380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:33.644943 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:33.645428 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:33.795144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:33.801006 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-141027b7-f8e3-424c-b464-d4279bef0359 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.169956 Aug 24 06:50:33.801903 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 538/1049] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:33 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:33.985874 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:33.987877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:33.995333 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:33.995913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:33.996352 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:33.997066 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:33.997605 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:33.998029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:34.144017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:34.153302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:34.156507 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:34.157130 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7d47238e-0a5e-459b-af5f-dfa438666c40 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.176488 Aug 24 06:50:34.171274 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 512/1050] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:33 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:34.822934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:34.823550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:34.830137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:34.830619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:34.831202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:34.832035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:34.832490 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:34.832913 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:34.964711 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:34.972991 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4e7e99fb-944d-43d3-ade3-40255cc2b28c tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.153965 Aug 24 06:50:34.973603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 539/1051] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:34 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:35.181276 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:35.181863 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:35.188283 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:35.188757 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:35.189200 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:35.189878 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:35.190490 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:35.191067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:35.337391 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:35.347378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:35.349278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:35.350686 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c6f8a564-1769-4e84-b5ef-863b6a94b2c5 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.173450 Aug 24 06:50:35.351431 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 513/1052] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:35 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:35.993800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:35.994434 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:36.000933 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:36.001458 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:36.001892 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:36.002585 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:36.003034 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:36.004091 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:36.138633 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:36.148219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-51f1d162-fa62-4003-bfa8-e76b74c3a672 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.158328 Aug 24 06:50:36.148860 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 540/1053] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:35 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:36.375938 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:36.376540 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:36.384187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:36.384977 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:36.385434 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:36.386396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:36.386846 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:36.387264 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:36.539882 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:36.549917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:36.553865 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:36.555413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8a913288-91a0-4820-80eb-5172fd9d74b4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.183055 Aug 24 06:50:36.561778 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 514/1054] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:36 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:37.170531 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:37.171105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:37.179628 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:37.180116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:37.180558 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:37.181291 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:37.183553 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:37.183553 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:37.320827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:37.328753 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-92786ba8-d424-414f-bf2c-d68ac7e679b1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.163380 Aug 24 06:50:37.329423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 541/1055] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:37 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:37.578634 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:37.579187 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:37.587424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:37.587911 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:37.588347 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:37.589293 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:37.589748 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:37.590167 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:37.743409 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:37.752788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:37.754943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:37.756189 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d81e7eeb-a076-48ef-9730-b4b507ed0289 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.181600 Aug 24 06:50:37.756918 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 515/1056] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:37 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:38.351441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:38.352048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:38.358302 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:38.358775 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:38.359241 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:38.364705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:38.364705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:38.364705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:38.525489 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:38.539282 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-43bae17f-dee9-4f39-b84f-426d61f27b50 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.192560 Aug 24 06:50:38.540144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 542/1057] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:38 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:38.779814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:38.781952 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:38.796020 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:38.799752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:38.800981 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:38.802012 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:38.802654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:38.804304 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:38.845008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-a85627bb-4978-4479-9684-a204a2514ff3 req-fda46d10-1521-4d6e-b287-b97ee32d9ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c89f8cf-aaa8-43d8-b632-88ecd0690a8a", "name": "network-vif-plugged", "status": "completed", "tag": "bc6fe70d-98e9-4938-bfac-e7e933f3b282"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:38.868306 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a85627bb-4978-4479-9684-a204a2514ff3 req-fda46d10-1521-4d6e-b287-b97ee32d9ea1 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:38.868836 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a85627bb-4978-4479-9684-a204a2514ff3 req-fda46d10-1521-4d6e-b287-b97ee32d9ea1 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:38.869445 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a85627bb-4978-4479-9684-a204a2514ff3 req-fda46d10-1521-4d6e-b287-b97ee32d9ea1 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:38.884693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-a85627bb-4978-4479-9684-a204a2514ff3 req-fda46d10-1521-4d6e-b287-b97ee32d9ea1 service nova] Creating event network-vif-plugged:bc6fe70d-98e9-4938-bfac-e7e933f3b282 for instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a on hv-cinder-85427 Aug 24 06:50:38.892069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-a85627bb-4978-4479-9684-a204a2514ff3 req-fda46d10-1521-4d6e-b287-b97ee32d9ea1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051117 Aug 24 06:50:38.894038 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 543/1058] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:50:38.969242 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:38.977591 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:38.981075 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:38.982785 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:38.984704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4c99c8bf-4ea5-4f70-be91-15974b65af76 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.209228 Aug 24 06:50:38.989441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 516/1059] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:38 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:39.564339 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:39.565035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:39.573197 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:39.573691 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:39.574119 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:39.574827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:39.575277 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:39.575700 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:39.725248 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:39.733432 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-91191567-c4a6-45bc-8da0-5da8e5cb8ed8 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.173120 Aug 24 06:50:39.733992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 544/1060] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:39 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:40.014901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:40.015515 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:40.023515 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:40.024000 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:40.024505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:40.025149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:40.025632 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:40.026102 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:40.194336 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:40.203592 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:40.205372 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:40.207122 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8952b903-216c-4ed6-93c3-3acc9bc8cdd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.195591 Aug 24 06:50:40.215007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 517/1061] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:40 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:40.758790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:40.759363 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:40.772183 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:40.772826 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:40.773369 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:40.774198 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:40.774756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:40.775269 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:40.930330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:40.944468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e9aa45aa-66b0-4032-b112-db1d59e74389 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.190120 Aug 24 06:50:40.945695 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 545/1062] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:40 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:41.231708 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:41.232428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:41.241722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:41.242623 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:41.243069 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:41.243865 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:41.244577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:41.245004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:41.396652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:41.405577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:41.407110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:41.408399 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-275f6f8f-19a7-47b0-97e2-0f764ce2120e tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.180737 Aug 24 06:50:41.409045 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 518/1063] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:41 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:41.978764 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:41.979413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:41.985998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:41.986493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:41.986932 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:41.988283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:41.988752 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:41.989172 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:42.135782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:42.152067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6618bc8d-80cd-4af1-be77-c6a84e25c5ae tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.177137 Aug 24 06:50:42.156133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 546/1064] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:41 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:42.433826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:42.434486 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:42.443571 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:42.444079 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:42.444550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:42.445371 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:42.445834 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:42.446260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:42.741971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:42.741971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:42.743290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:42.743290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d5112d82-6afc-4a21-88a7-36652df1ae69 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.183043 Aug 24 06:50:42.743290 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 519/1065] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:42 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:43.175253 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:43.175873 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:43.182400 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:43.182918 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:43.183353 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:43.184053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:43.184532 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:43.184953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:43.327465 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:43.335983 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6f3099f0-9092-472c-af3b-3d39342f4d0d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.164715 Aug 24 06:50:43.336568 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 547/1066] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:43 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:50:43.636067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:43.636677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:43.643353 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:43.643965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:43.644396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:43.645769 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:43.646207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:43.646626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:43.782894 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:43.792359 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:43.792893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:43.794087 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b915ec93-c04c-4714-a0d3-80a2a2d2c194 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.161952 Aug 24 06:50:43.794662 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 520/1067] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:43 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:44.357402 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:44.357984 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:44.365471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:44.365956 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:44.366387 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:44.367090 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:44.367534 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:44.367952 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:44.521811 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:44.525766 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=100 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:44.530768 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7446d768-b021-4dcb-a3ab-8e21c8740b39 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.177235 Aug 24 06:50:44.531351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 548/1068] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:44 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:44.821451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:44.822357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:44.829511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:44.830317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:44.830974 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:44.832753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:44.833434 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:44.833893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:44.995218 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:45.004390 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:45.005881 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:45.007055 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-04aa1fcf-0f44-492c-a1cf-5128f5f89f51 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.193158 Aug 24 06:50:45.007621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 521/1069] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:44 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:45.552916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:45.553554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:45.560436 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:45.560910 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:45.561374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:45.562061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:45.562504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:45.562958 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:45.744931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:45.756752 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-546c4693-1d18-4fab-bdc2-338ef15bd742 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.208516 Aug 24 06:50:45.757236 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 549/1070] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:45 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:46.032016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:46.032983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:46.042232 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:46.042726 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:46.043163 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:46.043894 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:46.044344 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:46.044764 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:46.193506 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:46.202455 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:46.203987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:46.205212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f9320a8e-809d-47a4-97e3-793028cc1d2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.178034 Aug 24 06:50:46.206545 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 522/1071] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:46 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:50:46.778022 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:46.778905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:46.787197 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:46.787688 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:46.788116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:46.788894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:46.789391 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:46.789808 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:46.938397 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:46.948612 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ba050ae2-0e73-4c54-90f9-e8c3e0215d93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.174457 Aug 24 06:50:46.949458 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 550/1072] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:46 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:47.230339 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:47.231722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:47.238529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:47.239441 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:47.240281 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:47.241313 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:47.242002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:47.242838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:47.684655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:47.708356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:47.708356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:47.708356 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-552d41d3-644d-488a-996c-de8952ea9421 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.473784 Aug 24 06:50:47.708683 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 523/1073] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:47 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:47.971560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:47.972316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:47.975202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:47.980295 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:47.980747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:47.981283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:47.981862 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:47.982321 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:47.982719 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:48.125538 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:48.134598 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7af7b384-ae2d-404a-b8c3-a90c0e95c513 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.167126 Aug 24 06:50:48.135157 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 551/1074] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:47 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:48.724908 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:48.725544 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:48.731900 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:48.736821 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:48.736821 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:48.736821 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:48.736821 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:48.737207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:48.881704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:48.891589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:48.894198 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:48.896467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-bc46e275-d5cf-4ea4-9644-bf7e1010ec63 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.176160 Aug 24 06:50:48.897128 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 524/1075] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:48 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:49.156620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:49.157577 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:49.164853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:49.165458 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:49.165887 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:49.166572 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:49.167014 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:49.167427 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:49.309734 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:49.320469 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-aa6c6acc-4e5d-4836-85f4-e6ce24ac3b85 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1266 microversion: 2.1 time: 0.168310 Aug 24 06:50:49.321591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 552/1076] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:49 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:49.920586 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:49.921278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:49.928655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:49.929142 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:49.929603 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:49.930306 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:49.930759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:49.931230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.069962 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:50.078458 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:50.080052 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:50.081227 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b39b6320-d0b0-407c-be70-7654286235f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.165028 Aug 24 06:50:50.081845 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 525/1077] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:49 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:50.342554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:50.343414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:50.350421 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:50.350896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:50.351322 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.352024 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:50.352485 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:50.352871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.498411 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:50.504801 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b4a5b15d-2ea5-48f9-b393-c3877844b7dd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:50.504801 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b4a5b15d-2ea5-48f9-b393-c3877844b7dd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:50.506272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ca9cf209-87a2-4875-a55e-e38fd2355be4 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1454 microversion: 2.1 time: 0.167541 Aug 24 06:50:50.507592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 553/1078] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:50 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:50.510445 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b4a5b15d-2ea5-48f9-b393-c3877844b7dd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:50.510924 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b4a5b15d-2ea5-48f9-b393-c3877844b7dd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:50.511527 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b4a5b15d-2ea5-48f9-b393-c3877844b7dd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.512292 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b4a5b15d-2ea5-48f9-b393-c3877844b7dd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:50.512745 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b4a5b15d-2ea5-48f9-b393-c3877844b7dd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:50.513432 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b4a5b15d-2ea5-48f9-b393-c3877844b7dd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.526938 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:50.527541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:50.533889 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:50.534368 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:50.534796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.537697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:50.537697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:50.537697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.546535 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b4a5b15d-2ea5-48f9-b393-c3877844b7dd tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/911e78f9-5f8d-48b2-a124-8dcf216ee454" status: 200 len: 194 microversion: 2.1 time: 0.047610 Aug 24 06:50:50.547307 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 526/1079] 10.222.0.47 () {58 vars in 1413 bytes} [Wed Aug 24 06:50:50 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/911e78f9-5f8d-48b2-a124-8dcf216ee454 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:50:50.557978 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:50.558467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:50.564300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:50.564775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:50.565234 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.573532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:50.573532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:50.573532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.667210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lazy-loading 'services' on Instance uuid 03e77cd4-6087-440c-b857-1dc22f18eb4f {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:50:50.682598 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:50.700721 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9c7c081b-ac2f-41f2-9b14-f3ee436ebc93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1454 microversion: 2.1 time: 0.177480 Aug 24 06:50:50.715589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 554/1080] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:50 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1454 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:50:50.778858 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-a9674a44-234c-475e-94a3-d172ff988a31 req-998b48f9-607f-4d24-b824-348d0558525f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391581a7-43ed-48fd-add7-cbc73108eae4", "name": "network-vif-plugged", "status": "completed", "tag": "0621de02-3d16-4e02-ac8f-b0ed8b589e93"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:50.791045 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a9674a44-234c-475e-94a3-d172ff988a31 req-998b48f9-607f-4d24-b824-348d0558525f service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:50.791530 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a9674a44-234c-475e-94a3-d172ff988a31 req-998b48f9-607f-4d24-b824-348d0558525f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:50.791963 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-a9674a44-234c-475e-94a3-d172ff988a31 req-998b48f9-607f-4d24-b824-348d0558525f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:50.808219 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-a9674a44-234c-475e-94a3-d172ff988a31 req-998b48f9-607f-4d24-b824-348d0558525f service nova] Creating event network-vif-plugged:0621de02-3d16-4e02-ac8f-b0ed8b589e93 for instance 391581a7-43ed-48fd-add7-cbc73108eae4 on hv-cinder-85427 Aug 24 06:50:50.814504 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-a9674a44-234c-475e-94a3-d172ff988a31 req-998b48f9-607f-4d24-b824-348d0558525f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042266 Aug 24 06:50:50.825732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 555/1081] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:50:50.973373 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1220df8f-ed52-4311-bbae-5135caef4e62 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "DELETE /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/911e78f9-5f8d-48b2-a124-8dcf216ee454" status: 202 len: 0 microversion: 2.1 time: 0.418894 Aug 24 06:50:50.974532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 527/1082] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:50:50 2022] DELETE /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments/911e78f9-5f8d-48b2-a124-8dcf216ee454 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:50:51.418766 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:51.422448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:51.425763 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:51.426251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:51.427297 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:51.428014 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:51.428478 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:51.428896 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:51.571863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:51.581131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:51.581652 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:51.582799 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-de099c33-1e2f-4f12-a1a8-2b2d9aa5c5c2 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.482322 Aug 24 06:50:51.584148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 556/1083] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:51 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:52.610560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:52.611341 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:52.619269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:52.619772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:52.620209 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:52.621090 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:52.621578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:52.624198 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:52.860694 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:52.870235 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:52.872162 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:52.873553 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7bb69092-938c-4a04-bb23-00945e82228c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.268959 Aug 24 06:50:52.874257 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 528/1084] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:52 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:53.134007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-6cbf49bd-2ffa-4528-893c-12f5fcb4bd4d req-b260f882-7509-4c21-aee4-255e25a72cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c89f8cf-aaa8-43d8-b632-88ecd0690a8a", "tag": "bc6fe70d-98e9-4938-bfac-e7e933f3b282"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:53.147834 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-6cbf49bd-2ffa-4528-893c-12f5fcb4bd4d req-b260f882-7509-4c21-aee4-255e25a72cf0 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:53.148398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-6cbf49bd-2ffa-4528-893c-12f5fcb4bd4d req-b260f882-7509-4c21-aee4-255e25a72cf0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:53.148899 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-6cbf49bd-2ffa-4528-893c-12f5fcb4bd4d req-b260f882-7509-4c21-aee4-255e25a72cf0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:53.161094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-6cbf49bd-2ffa-4528-893c-12f5fcb4bd4d req-b260f882-7509-4c21-aee4-255e25a72cf0 service nova] Creating event network-changed:bc6fe70d-98e9-4938-bfac-e7e933f3b282 for instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a on hv-cinder-85427 Aug 24 06:50:53.166994 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-6cbf49bd-2ffa-4528-893c-12f5fcb4bd4d req-b260f882-7509-4c21-aee4-255e25a72cf0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037631 Aug 24 06:50:53.167614 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 557/1085] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:53.221317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-862a6a5e-8a7b-4232-8d98-fc6417250aaa tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:53.224285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-862a6a5e-8a7b-4232-8d98-fc6417250aaa tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:53.230018 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-862a6a5e-8a7b-4232-8d98-fc6417250aaa tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:53.230496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-862a6a5e-8a7b-4232-8d98-fc6417250aaa tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:53.230917 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-862a6a5e-8a7b-4232-8d98-fc6417250aaa tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:53.231794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-862a6a5e-8a7b-4232-8d98-fc6417250aaa tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:53.232400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-862a6a5e-8a7b-4232-8d98-fc6417250aaa tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:53.232972 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-862a6a5e-8a7b-4232-8d98-fc6417250aaa tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:53.264618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-862a6a5e-8a7b-4232-8d98-fc6417250aaa tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047729 Aug 24 06:50:53.265210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 529/1086] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:50:53 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:50:53.388518 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8c24fc31-ecad-4566-81e2-93d261c7fd92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:53.390944 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8c24fc31-ecad-4566-81e2-93d261c7fd92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:53.398924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c24fc31-ecad-4566-81e2-93d261c7fd92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:53.399422 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c24fc31-ecad-4566-81e2-93d261c7fd92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:53.399850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c24fc31-ecad-4566-81e2-93d261c7fd92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:53.400540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c24fc31-ecad-4566-81e2-93d261c7fd92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:53.401164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c24fc31-ecad-4566-81e2-93d261c7fd92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:53.401756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c24fc31-ecad-4566-81e2-93d261c7fd92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:53.443612 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8c24fc31-ecad-4566-81e2-93d261c7fd92 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059280 Aug 24 06:50:53.444701 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 558/1087] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:50:53 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:50:53.542657 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:53.543894 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:53.554572 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:53.555792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:53.556535 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:53.557475 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:53.558117 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:53.558720 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:53.588408 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:50:53.898193 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:53.898810 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:53.909050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:53.909940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:53.910559 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:53.912107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:53.912791 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:53.926790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:53.997404 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7970c5ee-1e59-47af-8f22-cfe4a4a6c0df tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "DELETE /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 204 len: 0 microversion: 2.1 time: 0.457972 Aug 24 06:50:53.998904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 530/1088] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:53 2022] DELETE /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:50:54.010494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:54.012123 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:54.022959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:54.023926 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:54.024583 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:54.025734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:54.026516 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:54.027101 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:54.033756 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:54.130637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:54.140782 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:54.142582 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:54.147300 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-eae580e8-5a97-4d9b-9b74-afabee54184f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.250928 Aug 24 06:50:54.150187 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 559/1089] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:53 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:50:54.219062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:54.230762 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e4323fd1-ab54-4589-95b4-a231c680724d tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1673 microversion: 2.1 time: 0.226187 Aug 24 06:50:54.232284 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 531/1090] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:54 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1673 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:55.170420 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:55.171052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:55.178327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:55.179190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:55.179956 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:55.181454 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:55.182038 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:55.182481 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:55.253286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:55.253830 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:55.264340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:55.264960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:55.265299 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:55.266010 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:55.266464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:55.266888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:55.326987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:55.339102 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:55.340626 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:55.341861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8349384a-4d1a-4b7d-8c1d-c07d5113c411 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1730 microversion: 2.20 time: 0.175367 Aug 24 06:50:55.342798 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 560/1091] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:55 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:50:55.406159 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:55.414092 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b6351173-1cf3-40e9-b011-0f3f9228a8ad tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1673 microversion: 2.1 time: 0.165560 Aug 24 06:50:55.414652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 532/1092] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:55 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:56.366901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:56.367772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:56.374639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:56.375294 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:56.375888 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:56.376609 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:56.377223 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:56.377679 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:56.438104 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:56.439569 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:56.448763 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:56.449336 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:56.449770 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:56.450492 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:56.451370 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:56.451595 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:56.544711 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:56.553719 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:56.555251 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:56.557562 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-e51f91fc-9915-4240-b6c9-9cb2757c439b tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1717 microversion: 2.20 time: 0.195272 Aug 24 06:50:56.558116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 561/1093] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:56 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1717 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:56.700194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:56.708994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e4173145-6cdd-4b70-934a-6f44b64c0831 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1673 microversion: 2.1 time: 0.275634 Aug 24 06:50:56.719734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 533/1094] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:56 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1673 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:57.354221 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-306ba840-c264-4b3b-b81d-8764a37da51d req-0e940dc5-24d7-4e54-85f6-eaca58ac3a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e77cd4-6087-440c-b857-1dc22f18eb4f", "name": "network-vif-deleted", "tag": "1de9d1dd-a04a-4e7a-bbbf-54c6c43a4d2e"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:57.365129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-306ba840-c264-4b3b-b81d-8764a37da51d req-0e940dc5-24d7-4e54-85f6-eaca58ac3a25 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:57.365129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-306ba840-c264-4b3b-b81d-8764a37da51d req-0e940dc5-24d7-4e54-85f6-eaca58ac3a25 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:57.365380 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-306ba840-c264-4b3b-b81d-8764a37da51d req-0e940dc5-24d7-4e54-85f6-eaca58ac3a25 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:57.378182 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-306ba840-c264-4b3b-b81d-8764a37da51d req-0e940dc5-24d7-4e54-85f6-eaca58ac3a25 service nova] Creating event network-vif-deleted:1de9d1dd-a04a-4e7a-bbbf-54c6c43a4d2e for instance 03e77cd4-6087-440c-b857-1dc22f18eb4f on hv-cinder-85427 Aug 24 06:50:57.386467 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-306ba840-c264-4b3b-b81d-8764a37da51d req-0e940dc5-24d7-4e54-85f6-eaca58ac3a25 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035788 Aug 24 06:50:57.387081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 562/1095] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:57.734335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:57.738733 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:57.743543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:57.744284 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:57.744885 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:57.745810 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:57.746428 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:57.747194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:57.788834 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:57.789364 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:57.789808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:57.790268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lazy-loading 'fault' on Instance uuid 03e77cd4-6087-440c-b857-1dc22f18eb4f {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:50:58.065768 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9b29b53a7b490da29fbf6e5451c362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096ae1367ad84c7aaa0b5e96e22e9e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:58.077169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-89776fd8-dec6-4227-ba94-0404b5f0ee1c tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 200 len: 1326 microversion: 2.1 time: 0.347029 Aug 24 06:50:58.090076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 534/1096] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:57 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 1326 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:59.105447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:59.106583 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:59.112931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:59.113620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:59.114177 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:59.122154 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:59.122154 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:59.122154 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:59.132686 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] HTTP exception thrown: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Request method failure captured: Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f HTTP/1.1 Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfrIV4wY3VBWuxA3uVmpOJwqi_lYXqEpcOQ9hAgV7F3zLtoFBUXRwHdb-kG9nYUz3D16Ca50J4NpOmIhIdPzGmbr_dpHfcgSeycuRs3IA34p5kn8ydhaBkvo275rWWXXxH2zBulEVRYfmw7GSeG-Z7AE0KPdtF9kkSg8Q3iqTlv3sw Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:50:59.134507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_096ae1367ad84c7aaa0b5e96e22e9e32", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 8b9b29b53a7b490da29fbf6e5451c362 Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:50:59.135992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '03e77cd4-6087-440c-b857-1dc22f18eb4f'} Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:59.136797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:50:59.138723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:50:59.139948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Returning 404 to user: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:59.139948 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-23db9872-9db2-435c-81e4-b029964cf410 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 404 len: 111 microversion: 2.1 time: 0.035464 Aug 24 06:50:59.140695 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 563/1097] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:59 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:50:59.146161 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-eb6f15f3-85a3-41aa-a5af-748379d7c4a9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '.version_select at 0x7fb5d4827a60>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:59.306286 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-eb6f15f3-85a3-41aa-a5af-748379d7c4a9 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-693927803" status: 202 len: 0 microversion: 2.1 time: 0.164214 Aug 24 06:50:59.314093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 535/1098] 10.222.0.47 () {58 vars in 1218 bytes} [Wed Aug 24 06:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-693927803 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:51:02.725787 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:02.726391 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:02.732787 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:02.733430 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:02.733869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:02.734565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:02.735020 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:02.735485 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:02.748861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] HTTP exception thrown: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Request method failure captured: Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: DELETE /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f HTTP/1.1 Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfrIV4wY3VBWuxA3uVmpOJwqi_lYXqEpcOQ9hAgV7F3zLtoFBUXRwHdb-kG9nYUz3D16Ca50J4NpOmIhIdPzGmbr_dpHfcgSeycuRs3IA34p5kn8ydhaBkvo275rWWXXxH2zBulEVRYfmw7GSeG-Z7AE0KPdtF9kkSg8Q3iqTlv3sw Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:51:02.750475 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_096ae1367ad84c7aaa0b5e96e22e9e32", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 8b9b29b53a7b490da29fbf6e5451c362 Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.752081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '03e77cd4-6087-440c-b857-1dc22f18eb4f'} Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:51:02.753061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.754637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.756137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Returning 404 to user: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:51:02.756137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-7c70a490-dba2-4f02-952b-f8e8eb83b8a7 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "DELETE /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 404 len: 111 microversion: 2.1 time: 0.030440 Aug 24 06:51:02.756137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 564/1099] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:51:02 2022] DELETE /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:51:02.763119 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:02.763733 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 03e77cd4-6087-440c-b857-1dc22f18eb4f] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:02.769690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:02.770162 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:02.770587 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:02.771260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:02.771711 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:02.772116 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:02.786220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] HTTP exception thrown: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Request method failure captured: Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f HTTP/1.1 Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfrIV4wY3VBWuxA3uVmpOJwqi_lYXqEpcOQ9hAgV7F3zLtoFBUXRwHdb-kG9nYUz3D16Ca50J4NpOmIhIdPzGmbr_dpHfcgSeycuRs3IA34p5kn8ydhaBkvo275rWWXXxH2zBulEVRYfmw7GSeG-Z7AE0KPdtF9kkSg8Q3iqTlv3sw Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:51:02.789840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_096ae1367ad84c7aaa0b5e96e22e9e32", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 8b9b29b53a7b490da29fbf6e5451c362 Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.791601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '03e77cd4-6087-440c-b857-1dc22f18eb4f'} Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:51:02.792473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. Aug 24 06:51:02.793818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:02.795062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Returning 404 to user: Instance 03e77cd4-6087-440c-b857-1dc22f18eb4f could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:51:02.795062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-64729ffa-2293-4ce2-a328-a3d58fc0c6b3 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f" status: 404 len: 111 microversion: 2.1 time: 0.030916 Aug 24 06:51:02.795062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 536/1100] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:02 2022] GET /compute/v2.1/servers/03e77cd4-6087-440c-b857-1dc22f18eb4f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:51:04.096026 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:04.096606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:04.103122 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:04.103697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:04.104125 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:04.104816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:04.105301 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:04.109735 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:04.122607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] HTTP exception thrown: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Request method failure captured: Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: DELETE /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 HTTP/1.1 Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfrIV4wY3VBWuxA3uVmpOJwqi_lYXqEpcOQ9hAgV7F3zLtoFBUXRwHdb-kG9nYUz3D16Ca50J4NpOmIhIdPzGmbr_dpHfcgSeycuRs3IA34p5kn8ydhaBkvo275rWWXXxH2zBulEVRYfmw7GSeG-Z7AE0KPdtF9kkSg8Q3iqTlv3sw Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:51:04.124190 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_096ae1367ad84c7aaa0b5e96e22e9e32", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 8b9b29b53a7b490da29fbf6e5451c362 Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.125797 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '821b76aa-235d-42ca-aec6-6597a19525c0'} Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:51:04.130109 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.131591 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.133059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Returning 404 to user: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:51:04.133059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f59f1a3a-9d89-4f4f-a4de-6447b3d97502 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "DELETE /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 404 len: 111 microversion: 2.1 time: 0.033805 Aug 24 06:51:04.133059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 565/1101] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:51:04 2022] DELETE /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:51:04.138426 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:04.138426 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] [instance: 821b76aa-235d-42ca-aec6-6597a19525c0] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:04.141113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:04.146273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:04.146772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:04.147376 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:04.148109 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:04.148568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:04.148996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:04.163877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] HTTP exception thrown: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Request method failure captured: Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 HTTP/1.1 Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfrIV4wY3VBWuxA3uVmpOJwqi_lYXqEpcOQ9hAgV7F3zLtoFBUXRwHdb-kG9nYUz3D16Ca50J4NpOmIhIdPzGmbr_dpHfcgSeycuRs3IA34p5kn8ydhaBkvo275rWWXXxH2zBulEVRYfmw7GSeG-Z7AE0KPdtF9kkSg8Q3iqTlv3sw Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:51:04.166056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/096ae1367ad84c7aaa0b5e96e22e9e32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_096ae1367ad84c7aaa0b5e96e22e9e32", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 096ae1367ad84c7aaa0b5e96e22e9e32 Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-729870241 Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 8b9b29b53a7b490da29fbf6e5451c362 Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeTestJSON-729870241-project Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.167665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '821b76aa-235d-42ca-aec6-6597a19525c0'} Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:51:04.168928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. Aug 24 06:51:04.173867 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:51:04.175411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] Returning 404 to user: Instance 821b76aa-235d-42ca-aec6-6597a19525c0 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:51:04.175411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-454834c4-0a1e-43ff-bdf1-f49d1e90b551 tempest-AttachVolumeTestJSON-729870241 tempest-AttachVolumeTestJSON-729870241-project] 10.222.0.47 "GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0" status: 404 len: 111 microversion: 2.1 time: 0.035576 Aug 24 06:51:04.175411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 537/1102] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:04 2022] GET /compute/v2.1/servers/821b76aa-235d-42ca-aec6-6597a19525c0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:51:42.468409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4f5ed2a1-f9f8-4164-ae73-f5eaf34917c9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:42.468992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4f5ed2a1-f9f8-4164-ae73-f5eaf34917c9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:42.471151 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=29 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:42.472033 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=78 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:42.476441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f5ed2a1-f9f8-4164-ae73-f5eaf34917c9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:42.476920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f5ed2a1-f9f8-4164-ae73-f5eaf34917c9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:42.477408 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f5ed2a1-f9f8-4164-ae73-f5eaf34917c9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:42.478112 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f5ed2a1-f9f8-4164-ae73-f5eaf34917c9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:42.478559 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f5ed2a1-f9f8-4164-ae73-f5eaf34917c9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:42.478982 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4f5ed2a1-f9f8-4164-ae73-f5eaf34917c9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:42.503617 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4f5ed2a1-f9f8-4164-ae73-f5eaf34917c9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/ips" status: 200 len: 151 microversion: 2.1 time: 0.039627 Aug 24 06:51:42.504184 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 566/1103] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:51:42 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:51:49.517795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-4f70b1ee-8c33-48f3-ae24-76ec0e8fd157 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ff9cee-507e-47b5-93b6-c35853b9869d"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:51:49.520400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-4f70b1ee-8c33-48f3-ae24-76ec0e8fd157 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:49.522997 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=29 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:49.528164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4f70b1ee-8c33-48f3-ae24-76ec0e8fd157 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:49.528646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4f70b1ee-8c33-48f3-ae24-76ec0e8fd157 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:49.529075 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4f70b1ee-8c33-48f3-ae24-76ec0e8fd157 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:49.530056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4f70b1ee-8c33-48f3-ae24-76ec0e8fd157 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:49.530457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4f70b1ee-8c33-48f3-ae24-76ec0e8fd157 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:49.530667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-4f70b1ee-8c33-48f3-ae24-76ec0e8fd157 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:50.411616 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-4f70b1ee-8c33-48f3-ae24-76ec0e8fd157 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "POST /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.897359 Aug 24 06:51:50.412272 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 538/1104] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:51:49 2022] POST /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:00.209998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:00.210558 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:00.217872 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:00.218350 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:00.218789 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:00.219474 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:00.219921 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:00.220339 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:00.304922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lazy-loading 'services' on Instance uuid 48328e6b-2420-4a80-951c-5b3ec8b91c4d {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:52:00.546626 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d449050e-e0a1-4b91-b2c9-fd9a405e570b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments/04ff9cee-507e-47b5-93b6-c35853b9869d" status: 202 len: 0 microversion: 2.1 time: 0.340634 Aug 24 06:52:00.547036 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 567/1105] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:52:00 2022] DELETE /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments/04ff9cee-507e-47b5-93b6-c35853b9869d => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:52:00.557666 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1d52b7a4-d0b0-44d4-b531-a0fc9a13ea17 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:00.560081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1d52b7a4-d0b0-44d4-b531-a0fc9a13ea17 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:00.562808 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:00.563489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:00.568555 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d52b7a4-d0b0-44d4-b531-a0fc9a13ea17 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:00.569035 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d52b7a4-d0b0-44d4-b531-a0fc9a13ea17 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:00.569568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d52b7a4-d0b0-44d4-b531-a0fc9a13ea17 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:00.570383 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d52b7a4-d0b0-44d4-b531-a0fc9a13ea17 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:00.571059 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d52b7a4-d0b0-44d4-b531-a0fc9a13ea17 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:00.571548 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1d52b7a4-d0b0-44d4-b531-a0fc9a13ea17 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:00.605936 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1d52b7a4-d0b0-44d4-b531-a0fc9a13ea17 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053370 Aug 24 06:52:00.606493 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 539/1106] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:52:00 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:01.621859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b509fd31-f9e6-42f7-83bd-884f720adcff tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:01.623792 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b509fd31-f9e6-42f7-83bd-884f720adcff tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:01.630254 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b509fd31-f9e6-42f7-83bd-884f720adcff tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:01.630835 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b509fd31-f9e6-42f7-83bd-884f720adcff tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:01.631171 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b509fd31-f9e6-42f7-83bd-884f720adcff tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:01.631870 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b509fd31-f9e6-42f7-83bd-884f720adcff tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:01.632318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b509fd31-f9e6-42f7-83bd-884f720adcff tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:01.632776 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b509fd31-f9e6-42f7-83bd-884f720adcff tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:01.663124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b509fd31-f9e6-42f7-83bd-884f720adcff tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047494 Aug 24 06:52:01.663640 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 568/1107] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:52:01 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:02.676267 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d7ad8a9d-4c73-4118-a2f8-d3bfe6d5724b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:02.678561 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d7ad8a9d-4c73-4118-a2f8-d3bfe6d5724b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:02.686935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d7ad8a9d-4c73-4118-a2f8-d3bfe6d5724b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:02.694110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d7ad8a9d-4c73-4118-a2f8-d3bfe6d5724b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:02.694110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d7ad8a9d-4c73-4118-a2f8-d3bfe6d5724b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:02.694110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d7ad8a9d-4c73-4118-a2f8-d3bfe6d5724b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:02.694110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d7ad8a9d-4c73-4118-a2f8-d3bfe6d5724b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:02.694486 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d7ad8a9d-4c73-4118-a2f8-d3bfe6d5724b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:02.724561 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d7ad8a9d-4c73-4118-a2f8-d3bfe6d5724b tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052171 Aug 24 06:52:02.725034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 540/1108] 10.222.0.47 () {58 vars in 1302 bytes} [Wed Aug 24 06:52:02 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:52:02.790148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:02.790812 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:02.797129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:02.797657 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:02.798064 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:02.798741 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:02.799183 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:02.799597 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:02.827308 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:52:03.117732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b45ce212-39b2-4e91-9786-968a661801fb tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 204 len: 0 microversion: 2.1 time: 0.331140 Aug 24 06:52:03.119000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 569/1109] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:52:02 2022] DELETE /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:52:03.128216 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:03.128817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:03.135212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:03.135700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:03.136134 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:03.136842 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:03.137322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:03.137741 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:03.276888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:03.284961 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-76f198ef-e1d6-43bd-9ebf-6936733fe0cd tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1682 microversion: 2.1 time: 0.161313 Aug 24 06:52:03.285572 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 541/1110] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:03 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:04.308199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:04.308894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:04.315291 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:04.315773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:04.316240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:04.316929 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:04.317409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:04.317825 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:04.456371 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:04.464862 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-16b2566c-4c02-4998-83bb-d2e995149983 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1682 microversion: 2.1 time: 0.161418 Aug 24 06:52:04.466005 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 570/1111] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:04 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:05.486739 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:05.487379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:05.493847 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:05.494317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:05.494744 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:05.495415 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:05.496030 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:05.496447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:05.632324 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:05.640958 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-61703484-d041-495c-b3ce-8123283bf5d0 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1682 microversion: 2.1 time: 0.158046 Aug 24 06:52:05.641654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 542/1112] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:05 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:06.666059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:06.666756 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:06.675585 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:06.676344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:06.676788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:06.677514 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:06.677967 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:06.678405 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:06.787186 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:06.796937 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5c0dd726-b450-47e7-8dcd-e910b65c768d tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1615 microversion: 2.1 time: 0.137814 Aug 24 06:52:06.798262 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 571/1113] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:06 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1615 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:06.958172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-05ae357d-1929-4735-bde8-8b6ef63461f5 req-e5143525-969a-47cc-9104-32e7ea4b176c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48328e6b-2420-4a80-951c-5b3ec8b91c4d", "name": "network-vif-deleted", "tag": "2ea9414b-1fc6-4f5d-98b4-e86ba17be292"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:06.969048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-05ae357d-1929-4735-bde8-8b6ef63461f5 req-e5143525-969a-47cc-9104-32e7ea4b176c service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:06.969558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-05ae357d-1929-4735-bde8-8b6ef63461f5 req-e5143525-969a-47cc-9104-32e7ea4b176c service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:06.970064 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-05ae357d-1929-4735-bde8-8b6ef63461f5 req-e5143525-969a-47cc-9104-32e7ea4b176c service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:06.982491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-05ae357d-1929-4735-bde8-8b6ef63461f5 req-e5143525-969a-47cc-9104-32e7ea4b176c service nova] Creating event network-vif-deleted:2ea9414b-1fc6-4f5d-98b4-e86ba17be292 for instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d on hv-cinder-85427 Aug 24 06:52:06.987717 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-05ae357d-1929-4735-bde8-8b6ef63461f5 req-e5143525-969a-47cc-9104-32e7ea4b176c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302061 Aug 24 06:52:06.988572 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 543/1114] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:07.820630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:07.822008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:07.829461 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:07.829950 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:07.830448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:07.831377 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:07.831891 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:07.832240 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:07.870008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:07.870488 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:07.870922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:07.871447 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lazy-loading 'fault' on Instance uuid 48328e6b-2420-4a80-951c-5b3ec8b91c4d {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:52:07.912398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ad6cdc4ffe4917a7bbf6814297f980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91004b0497d487ea8f1f454c03bbca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:07.920638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c9bd79f1-7050-4eb6-a814-09dcd92cf32f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 200 len: 1331 microversion: 2.1 time: 0.103824 Aug 24 06:52:07.921276 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 572/1115] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:07 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:08.943149 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:08.943844 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:08.950050 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:08.951241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:08.951677 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:08.952512 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:08.952959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:08.953403 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:08.967826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d HTTP/1.1 Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:52:08.969612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:08.971983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '48328e6b-2420-4a80-951c-5b3ec8b91c4d'} Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:08.973002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:08.974604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:08.975994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:08.975994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-385e883d-2714-44e8-a77d-111bb9eecb1e tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 404 len: 111 microversion: 2.1 time: 0.032914 Aug 24 06:52:08.975994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 544/1116] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:08 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:52:08.980158 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b56892b1-25f9-4c4a-92bb-86e61de2f280 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '.version_select at 0x7fb5d46fc5e0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:09.078805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b56892b1-25f9-4c4a-92bb-86e61de2f280 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132266102" status: 202 len: 0 microversion: 2.1 time: 0.102475 Aug 24 06:52:09.079382 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 573/1117] 10.222.0.47 () {58 vars in 1221 bytes} [Wed Aug 24 06:52:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132266102 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:52:11.203577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:11.204085 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:11.210863 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:11.211340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:11.211772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:11.212464 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:11.212911 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:11.213394 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:11.227310 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d HTTP/1.1 Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:52:11.228851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.230451 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '48328e6b-2420-4a80-951c-5b3ec8b91c4d'} Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:11.231815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.233824 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.235197 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:11.235197 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-215d76ac-7291-4740-b7cd-c03d78cc3967 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 404 len: 111 microversion: 2.1 time: 0.030614 Aug 24 06:52:11.235197 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 545/1118] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:52:11 2022] DELETE /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:52:11.239527 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:11.240170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 48328e6b-2420-4a80-951c-5b3ec8b91c4d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:11.248810 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:11.249315 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:11.249757 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:11.250456 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:11.250904 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:11.251322 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:11.264600 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d HTTP/1.1 Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:52:11.266271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.267894 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '48328e6b-2420-4a80-951c-5b3ec8b91c4d'} Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:11.268805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. Aug 24 06:52:11.270347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:11.271647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance 48328e6b-2420-4a80-951c-5b3ec8b91c4d could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:11.271647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-be18e164-916b-4599-9c8e-716bf63a5032 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d" status: 404 len: 111 microversion: 2.1 time: 0.032063 Aug 24 06:52:11.271647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 574/1119] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:11 2022] GET /compute/v2.1/servers/48328e6b-2420-4a80-951c-5b3ec8b91c4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:52:12.544302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:12.544892 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:12.551382 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:12.551961 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:12.552440 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:12.553142 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:12.553617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:12.554036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:12.569012 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 HTTP/1.1 Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:52:12.570627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.572212 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '086395fc-028c-495d-993a-8fee70809181'} Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:12.573105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.574625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.576315 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:12.576315 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b2cb1242-864f-47c7-8741-8ead6e00bc7f tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 404 len: 111 microversion: 2.1 time: 0.031759 Aug 24 06:52:12.576315 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 546/1120] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:52:12 2022] DELETE /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:52:12.586613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:12.586613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 086395fc-028c-495d-993a-8fee70809181] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:12.589031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:12.589540 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:12.589971 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:12.590907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:12.591347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:12.591776 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:12.605265 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 HTTP/1.1 Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:52:12.606901 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.608693 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '086395fc-028c-495d-993a-8fee70809181'} Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:12.609683 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. Aug 24 06:52:12.611202 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.612586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance 086395fc-028c-495d-993a-8fee70809181 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:12.612586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-41202f6f-1179-4b24-85b6-8a00fabf45a2 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181" status: 404 len: 111 microversion: 2.1 time: 0.031388 Aug 24 06:52:12.612586 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 575/1121] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:12 2022] GET /compute/v2.1/servers/086395fc-028c-495d-993a-8fee70809181 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:52:12.617093 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:12.619970 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:12.624567 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:12.625437 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:12.625617 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:12.626312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:12.626763 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:12.627184 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:12.642144 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c HTTP/1.1 Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:52:12.656811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.658457 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '354c7880-d099-464f-b199-c14a91a1c25c'} Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:12.659350 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.660837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.662513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:12.662513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a4d9fa2f-85c0-4289-9e7d-af96108416f9 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 404 len: 111 microversion: 2.1 time: 0.032002 Aug 24 06:52:12.662513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 547/1122] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:52:12 2022] DELETE /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:52:12.663424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:12.664029 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: 354c7880-d099-464f-b199-c14a91a1c25c] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:12.669966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:12.671131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:12.671563 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:12.672269 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:12.672713 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:12.673128 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:12.687356 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c HTTP/1.1 Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:52:12.688796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.693412 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '354c7880-d099-464f-b199-c14a91a1c25c'} Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:12.694622 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. Aug 24 06:52:12.696115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:12.697607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance 354c7880-d099-464f-b199-c14a91a1c25c could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:12.697607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-825fb850-ef4a-4f16-abb5-a673b3f9b592 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c" status: 404 len: 111 microversion: 2.1 time: 0.030624 Aug 24 06:52:12.697607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 576/1123] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:12 2022] GET /compute/v2.1/servers/354c7880-d099-464f-b199-c14a91a1c25c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:52:15.037468 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:15.038024 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:15.044353 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:15.048477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:15.048477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:15.048477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:15.048477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:15.048880 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:15.062107 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 HTTP/1.1 Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:52:15.063791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.065379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'b0298df5-f99f-4390-8f6f-3320fdfaff52'} Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:15.066300 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.067843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.069387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:15.069387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8a2a26a5-294b-487b-a3ed-0ac6472fc64c tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 404 len: 111 microversion: 2.1 time: 0.031725 Aug 24 06:52:15.069387 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 548/1124] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:52:15 2022] DELETE /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:52:15.074096 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:15.074726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] [instance: b0298df5-f99f-4390-8f6f-3320fdfaff52] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:15.081971 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:15.082456 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:15.082882 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:15.083566 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:15.084005 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:15.084416 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:15.098351 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] HTTP exception thrown: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Request method failure captured: Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 HTTP/1.1 Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfyt8kvj4g4xJ57Ykw_bbEijFsjylHcdHGOLQgq7dTQLlHkC1LocSHbqY2CPffd18nQ8jtu5iqlbf6VpO8P29c5MuI7tPa6GwbVWfADzbfN39AF2UmBXLa73dJZVJC--KQLVxK4gyXOhb3ZoTuuTiwLlSC6zLuhgsVnakCNXqInwb8 Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:52:15.105639 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b91004b0497d487ea8f1f454c03bbca0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b91004b0497d487ea8f1f454c03bbca0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: b91004b0497d487ea8f1f454c03bbca0 Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1716179038 Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 02ad6cdc4ffe4917a7bbf6814297f980 Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeNegativeTest-1716179038-project Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.108249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': 'b0298df5-f99f-4390-8f6f-3320fdfaff52'} Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:15.109163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. Aug 24 06:52:15.110662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:15.112040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] Returning 404 to user: Instance b0298df5-f99f-4390-8f6f-3320fdfaff52 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:15.112040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-56d647c7-5bfa-4f94-abd4-e5b97268d7d8 tempest-AttachVolumeNegativeTest-1716179038 tempest-AttachVolumeNegativeTest-1716179038-project] 10.222.0.47 "GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52" status: 404 len: 111 microversion: 2.1 time: 0.031125 Aug 24 06:52:15.112040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 577/1125] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:15 2022] GET /compute/v2.1/servers/b0298df5-f99f-4390-8f6f-3320fdfaff52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:52:35.185100 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f65de50a-b553-4755-b7ac-d065ab50d7f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:35.188872 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f65de50a-b553-4755-b7ac-d065ab50d7f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:35.191758 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=20 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:35.192413 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=36 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:35.199378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65de50a-b553-4755-b7ac-d065ab50d7f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:35.199869 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65de50a-b553-4755-b7ac-d065ab50d7f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:35.200299 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65de50a-b553-4755-b7ac-d065ab50d7f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:35.201021 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65de50a-b553-4755-b7ac-d065ab50d7f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:35.201505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65de50a-b553-4755-b7ac-d065ab50d7f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:35.201925 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f65de50a-b553-4755-b7ac-d065ab50d7f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:35.238102 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f65de50a-b553-4755-b7ac-d065ab50d7f4 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058218 Aug 24 06:52:35.238711 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 549/1126] 10.222.0.47 () {60 vars in 1343 bytes} [Wed Aug 24 06:52:35 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:35.319075 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:35.319862 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:35.323565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:35.324211 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:35.329594 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:35.330137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:35.330656 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:35.331743 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:35.332310 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:35.332822 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:35.360888 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:52:35.754804 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1c24c9c1-24df-4ce5-9ea0-75af8bbe2cc1 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "DELETE /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 204 len: 0 microversion: 2.20 time: 0.439276 Aug 24 06:52:35.755619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 578/1127] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 24 06:52:35 2022] DELETE /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 06:52:35.772818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:35.774116 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:35.781390 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:35.781928 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:35.785724 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:35.789675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:35.790541 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:35.790993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:35.954935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:35.963728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:35.965543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:35.966721 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-43f1e36d-5504-43fc-bf26-58f170238dd7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.206307 Aug 24 06:52:35.967269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 550/1128] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:35 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:52:36.853596 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:52:36.854443 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Wed Aug 24 06:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:52:36.991755 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:36.992792 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:37.001641 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:37.002136 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:37.002559 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:37.003331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:37.003711 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:37.004133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:37.237358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:37.248125 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:37.249902 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:37.250986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-83c96148-8603-49fd-985b-65f91508d303 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.263636 Aug 24 06:52:37.251863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 579/1129] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:36 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:52:38.279788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:38.280385 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:38.288181 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:38.288987 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:38.289892 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:38.290731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:38.291400 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:38.291825 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:38.638746 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:38.656825 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:38.666601 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:38.668214 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5e68a0bc-fefd-4665-beb9-8452d708aedf tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1723 microversion: 2.20 time: 0.395748 Aug 24 06:52:38.683782 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 551/1130] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:38 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:52:39.694448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:39.695627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:39.702826 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:39.703307 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:39.703914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:39.710131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:39.710131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:39.710131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:39.781640 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:39.798788 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:39.800887 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:39.802863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-9acd89f2-897b-403c-99ca-fd45b0a4e9db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1656 microversion: 2.20 time: 0.112336 Aug 24 06:52:39.810111 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 580/1131] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:39 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1656 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:52:39.875474 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-106fc995-1e12-44b9-8e10-98b8779bb347 req-f9eb646c-582f-4b30-953a-5ae004afce11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391581a7-43ed-48fd-add7-cbc73108eae4", "name": "network-vif-deleted", "tag": "0621de02-3d16-4e02-ac8f-b0ed8b589e93"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:39.891738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-106fc995-1e12-44b9-8e10-98b8779bb347 req-f9eb646c-582f-4b30-953a-5ae004afce11 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:39.892554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-106fc995-1e12-44b9-8e10-98b8779bb347 req-f9eb646c-582f-4b30-953a-5ae004afce11 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:39.893433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-106fc995-1e12-44b9-8e10-98b8779bb347 req-f9eb646c-582f-4b30-953a-5ae004afce11 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:39.908320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-106fc995-1e12-44b9-8e10-98b8779bb347 req-f9eb646c-582f-4b30-953a-5ae004afce11 service nova] Creating event network-vif-deleted:0621de02-3d16-4e02-ac8f-b0ed8b589e93 for instance 391581a7-43ed-48fd-add7-cbc73108eae4 on hv-cinder-85427 Aug 24 06:52:39.914893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-106fc995-1e12-44b9-8e10-98b8779bb347 req-f9eb646c-582f-4b30-953a-5ae004afce11 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049153 Aug 24 06:52:39.916155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 552/1132] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:40.832262 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:40.832909 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:40.853064 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:40.854097 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:40.855237 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:40.855916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:40.856603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:40.857331 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:40.944253 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:40.954587 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:40.956421 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:40.957886 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-703470a0-7098-4090-87cc-1c7ad863876f tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1366 microversion: 2.20 time: 0.129730 Aug 24 06:52:40.958624 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 581/1133] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:40 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:52:41.984587 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:41.985303 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:41.991935 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:41.992466 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:41.992900 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:41.993629 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:41.994080 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:41.994504 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:42.026310 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:42.026795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:42.027223 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:42.027668 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lazy-loading 'fault' on Instance uuid 391581a7-43ed-48fd-add7-cbc73108eae4 {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:52:42.110421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:42.120067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:42.121604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:42.123036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a879d3db-a3e0-46f5-8df5-76460b20c8e8 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1371 microversion: 2.20 time: 0.143078 Aug 24 06:52:42.123751 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 553/1134] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:41 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:52:43.149469 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:43.150748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:43.159073 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:43.160487 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:43.161116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:43.162087 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:43.162955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:43.164328 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:43.214645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:43.215433 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:43.215873 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:43.216463 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lazy-loading 'fault' on Instance uuid 391581a7-43ed-48fd-add7-cbc73108eae4 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:52:43.303468 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:43.312935 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:43.314613 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52f796d5013d4a31b107fb86c5523c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bf995c8c544dc29f42e53866cc6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:43.316071 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-27aca6a0-d71b-4950-bff0-896366c2782a tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 200 len: 1371 microversion: 2.20 time: 0.171961 Aug 24 06:52:43.317094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 582/1135] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:43 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:52:44.342472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:44.343971 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:44.353320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:44.354960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:44.355411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:44.356379 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:44.357058 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:44.357819 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:44.374729 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] HTTP exception thrown: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Request method failure captured: Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 HTTP/1.1 Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfy7p4tsltEbE1yh4M2yRaU4yx7GTB4GuYO-1q67SnWqXEpRsvL3hrxx1W8aH8kmAXQvvejnH7vpJR_sWM2t-lQnYJRyvUg6A0ZaxgkGDGW7zm5YyScCHB5TIIurkjw2haDAaUr3nijSCchE29A1NTLS80cR1EWYJViA5WH7DWZzvU Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:52:44.376837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e1bf995c8c544dc29f42e53866cc6bd2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 52f796d5013d4a31b107fb86c5523c9c Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:44.378749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '391581a7-43ed-48fd-add7-cbc73108eae4'} Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:44.379722 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:44.381777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:44.385954 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Returning 404 to user: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:44.387016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d01efd16-a3ce-48ea-bd77-b6522b28f925 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 404 len: 111 microversion: 2.20 time: 0.049621 Aug 24 06:52:44.388283 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 554/1136] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:44 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:52:44.396755 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-820f4ffb-d04c-4573-954d-b9d591f9ce3c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '.version_select at 0x7fb5d4615dc0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:44.528614 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-820f4ffb-d04c-4573-954d-b9d591f9ce3c tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665440967" status: 204 len: 0 microversion: 2.20 time: 0.135649 Aug 24 06:52:44.532773 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 583/1137] 10.222.0.47 () {60 vars in 1262 bytes} [Wed Aug 24 06:52:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665440967 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 06:52:47.619267 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6db69954-70b4-405e-acb3-cc33896f53d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Action: 'create', calling method: .version_select at 0x7fb5d4827d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-277619539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/nGf8m5i4JGsiMsZ78cevsjyAxS5NHl+nIrLMR0pePWUywPt4LDNzxe0mEtizpG7QCDrlg/6ZEaVsmbrOgyQj6ReZS+6ZdiJld+USd+pMsbzlt9cOmDZaJxl5Rz5yl2w=="}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:47.636440 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-6db69954-70b4-405e-acb3-cc33896f53d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Getting quotas for project 0cc00174433b49a2980339c2963671b0. Resources: {'key_pairs'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:52:47.640608 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-6db69954-70b4-405e-acb3-cc33896f53d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Getting quotas for user 2e6e7001705b47a09b6e5d7f08595fc8 and project 0cc00174433b49a2980339c2963671b0. Resources: {'key_pairs'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:52:47.751366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6db69954-70b4-405e-acb3-cc33896f53d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.313169 Aug 24 06:52:47.751965 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 555/1138] 10.222.0.47 () {60 vars in 1159 bytes} [Wed Aug 24 06:52:47 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:51.564710 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:51.565418 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:51.572775 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:51.573289 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:51.573715 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:51.574410 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:51.575062 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:51.575607 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] HTTP exception thrown: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Request method failure captured: Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: DELETE /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 HTTP/1.1 Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfy7p4tsltEbE1yh4M2yRaU4yx7GTB4GuYO-1q67SnWqXEpRsvL3hrxx1W8aH8kmAXQvvejnH7vpJR_sWM2t-lQnYJRyvUg6A0ZaxgkGDGW7zm5YyScCHB5TIIurkjw2haDAaUr3nijSCchE29A1NTLS80cR1EWYJViA5WH7DWZzvU Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:52:51.593107 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e1bf995c8c544dc29f42e53866cc6bd2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 52f796d5013d4a31b107fb86c5523c9c Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.595067 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '391581a7-43ed-48fd-add7-cbc73108eae4'} Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:51.595859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.598385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.599863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Returning 404 to user: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:51.599863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-631d3d3b-3888-4910-9c3e-9566f6ed0930 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "DELETE /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 404 len: 111 microversion: 2.20 time: 0.033486 Aug 24 06:52:51.599863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 584/1139] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 24 06:52:51 2022] DELETE /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:52:51.604048 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:51.605211 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: 391581a7-43ed-48fd-add7-cbc73108eae4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:51.612269 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:51.612753 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:51.613202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:51.613904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:51.614351 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:51.614767 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:51.629226 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] HTTP exception thrown: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Request method failure captured: Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 HTTP/1.1 Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfy7p4tsltEbE1yh4M2yRaU4yx7GTB4GuYO-1q67SnWqXEpRsvL3hrxx1W8aH8kmAXQvvejnH7vpJR_sWM2t-lQnYJRyvUg6A0ZaxgkGDGW7zm5YyScCHB5TIIurkjw2haDAaUr3nijSCchE29A1NTLS80cR1EWYJViA5WH7DWZzvU Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:52:51.630710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e1bf995c8c544dc29f42e53866cc6bd2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 52f796d5013d4a31b107fb86c5523c9c Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.632169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '391581a7-43ed-48fd-add7-cbc73108eae4'} Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:51.632975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. Aug 24 06:52:51.634725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:51.635875 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Returning 404 to user: Instance 391581a7-43ed-48fd-add7-cbc73108eae4 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:51.635875 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-59f2f5cc-6ead-40d8-9394-7372a0a930d7 tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4" status: 404 len: 111 microversion: 2.20 time: 0.033162 Aug 24 06:52:51.635875 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 556/1140] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:51 2022] GET /compute/v2.1/servers/391581a7-43ed-48fd-add7-cbc73108eae4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:52:52.912968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:52.913659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:52.921409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:52.924147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:52.924147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:52.924147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:52.924147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:52.924614 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:52.937493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] HTTP exception thrown: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Request method failure captured: Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: DELETE /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d HTTP/1.1 Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcfy7p4tsltEbE1yh4M2yRaU4yx7GTB4GuYO-1q67SnWqXEpRsvL3hrxx1W8aH8kmAXQvvejnH7vpJR_sWM2t-lQnYJRyvUg6A0ZaxgkGDGW7zm5YyScCHB5TIIurkjw2haDAaUr3nijSCchE29A1NTLS80cR1EWYJViA5WH7DWZzvU Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:52:52.939061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e1bf995c8c544dc29f42e53866cc6bd2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 52f796d5013d4a31b107fb86c5523c9c Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.940778 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': 'fa5949cc-2133-40b8-9112-b5d571c05f9d'} Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:52.941748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.943009 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.945356 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Returning 404 to user: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:52.945356 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-178add21-bd0b-42a8-9a94-e6fdc2183f2d tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 404 len: 111 microversion: 2.20 time: 0.042753 Aug 24 06:52:52.945356 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 585/1141] 10.222.0.47 () {60 vars in 1280 bytes} [Wed Aug 24 06:52:52 2022] DELETE /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:52:52.951682 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:52.952291 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] [instance: fa5949cc-2133-40b8-9112-b5d571c05f9d] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:52.959029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:52.959507 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:52.959941 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:52.960621 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:52.961065 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:52.961509 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:52.976255 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] HTTP exception thrown: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Request method failure captured: Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d HTTP/1.1 Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcfy7p4tsltEbE1yh4M2yRaU4yx7GTB4GuYO-1q67SnWqXEpRsvL3hrxx1W8aH8kmAXQvvejnH7vpJR_sWM2t-lQnYJRyvUg6A0ZaxgkGDGW7zm5YyScCHB5TIIurkjw2haDAaUr3nijSCchE29A1NTLS80cR1EWYJViA5WH7DWZzvU Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:52:52.977822 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e1bf995c8c544dc29f42e53866cc6bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e1bf995c8c544dc29f42e53866cc6bd2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: e1bf995c8c544dc29f42e53866cc6bd2 Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-956436854 Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 52f796d5013d4a31b107fb86c5523c9c Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-956436854-project Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.979316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'fa5949cc-2133-40b8-9112-b5d571c05f9d'} Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:52:52.981340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. Aug 24 06:52:52.986480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:52:52.988260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] Returning 404 to user: Instance fa5949cc-2133-40b8-9112-b5d571c05f9d could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:52:52.988260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-15edbc47-18cf-478e-b6ab-d654380b99db tempest-AttachVolumeShelveTestJSON-956436854 tempest-AttachVolumeShelveTestJSON-956436854-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d" status: 404 len: 111 microversion: 2.20 time: 0.032073 Aug 24 06:52:52.988260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 557/1142] 10.222.0.47 () {60 vars in 1277 bytes} [Wed Aug 24 06:52:52 2022] GET /compute/v2.1/servers/fa5949cc-2133-40b8-9112-b5d571c05f9d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:52:58.656714 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-693a4a74-0b36-437e-ba6d-e8da3280d929 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Action: 'create', calling method: .version_select at 0x7fb5d8d5ed30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-187098640"}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:59.374594 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-693a4a74-0b36-437e-ba6d-e8da3280d929 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.849239 Aug 24 06:52:59.375205 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 586/1143] 10.222.0.47 () {60 vars in 1155 bytes} [Wed Aug 24 06:52:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 851 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 06:52:59.387452 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c08353fe-42d1-4680-9dcc-ae82ee716fb5 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d4725f70>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:59.394649 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=4 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:59.443794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c08353fe-42d1-4680-9dcc-ae82ee716fb5 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447" status: 200 len: 344 microversion: 2.1 time: 0.060258 Aug 24 06:52:59.444889 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 558/1144] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:52:59 2022] GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:00.459048 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c0178ff6-025b-436a-ac57-ad1eae1b0e01 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d469d160>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:00.507799 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c0178ff6-025b-436a-ac57-ad1eae1b0e01 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447" status: 200 len: 344 microversion: 2.1 time: 0.053082 Aug 24 06:53:00.510138 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 587/1145] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:53:00 2022] GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:01.523851 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ec015208-b837-4743-b19a-0876d1af1613 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d46e6c10>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:01.575259 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ec015208-b837-4743-b19a-0876d1af1613 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447" status: 200 len: 344 microversion: 2.1 time: 0.056663 Aug 24 06:53:01.575815 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 559/1146] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:53:01 2022] GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:02.589330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6ca2821d-26c1-49d5-abd6-7f8788d7c723 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d46535e0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:02.643632 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6ca2821d-26c1-49d5-abd6-7f8788d7c723 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447" status: 200 len: 345 microversion: 2.1 time: 0.059050 Aug 24 06:53:02.644291 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 588/1147] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:53:02 2022] GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:02.657717 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e51d4ec7-80bf-4289-a0e2-332224961956 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Action: 'create', calling method: .version_select at 0x7fb5d474adc0>, body: {"snapshot": {"volume_id": "6160402a-9517-4ed4-8527-948e7f6c2447", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-100675404"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:02.956956 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:02.967251 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=34 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:03.239349 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e51d4ec7-80bf-4289-a0e2-332224961956 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.585643 Aug 24 06:53:03.240691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 560/1148] 10.222.0.47 () {60 vars in 1162 bytes} [Wed Aug 24 06:53:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:03.248747 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:03.250491 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:03.253725 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c36ecc7f-8e33-4b43-b4a9-784adab1b5de tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d47b11f0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:03.284183 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c36ecc7f-8e33-4b43-b4a9-784adab1b5de tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.036010 Aug 24 06:53:03.284751 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 589/1149] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:03 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:03.296604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8f5453d7-fc29-44fb-8782-cba53c1d728b tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d4827d30>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:03.329020 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8f5453d7-fc29-44fb-8782-cba53c1d728b tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037136 Aug 24 06:53:03.329655 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 561/1150] 10.222.0.47 () {58 vars in 1140 bytes} [Wed Aug 24 06:53:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:03.342911 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-00aba1f6-d4f8-44d3-9d85-8c8b227cbf10 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d4615a60>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:03.376134 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-00aba1f6-d4f8-44d3-9d85-8c8b227cbf10 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.038986 Aug 24 06:53:03.376698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 590/1151] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:03 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:53:04.389273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-85443567-c113-4eeb-b4b1-e3f6aceff24d tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d46aaca0>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:04.420026 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-85443567-c113-4eeb-b4b1-e3f6aceff24d tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.035019 Aug 24 06:53:04.420985 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 562/1152] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:04 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:05.434428 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-243529ff-ed19-4410-ae30-e14f3529fd56 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d8d5ee50>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:05.468146 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-243529ff-ed19-4410-ae30-e14f3529fd56 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.038839 Aug 24 06:53:05.468723 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 591/1153] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:05 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:06.481335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3877a95e-f7ba-478f-abbb-e6fb5b877a6c tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d4725d30>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:06.510176 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3877a95e-f7ba-478f-abbb-e6fb5b877a6c tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.033662 Aug 24 06:53:06.511235 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 563/1154] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:06 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:07.524812 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3fb5331c-b528-44cd-8fd1-dde79f7da82d tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d4667160>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:07.555385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3fb5331c-b528-44cd-8fd1-dde79f7da82d tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.035802 Aug 24 06:53:07.555953 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 592/1155] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:07 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:08.568375 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ec2c6aa3-8cf3-4ba8-a90c-357801959763 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d46f8d30>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:08.599784 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ec2c6aa3-8cf3-4ba8-a90c-357801959763 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.035615 Aug 24 06:53:08.600386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 564/1156] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:08 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:09.613019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8263f5c1-9742-47a8-95dc-d74e7982cc2e tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d472cca0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:09.643249 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8263f5c1-9742-47a8-95dc-d74e7982cc2e tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.034444 Aug 24 06:53:09.643827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 593/1157] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:09 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:10.657496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7a9b70d1-b8ce-41f0-9470-9601f1bc8a08 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d474cb80>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:10.687435 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7a9b70d1-b8ce-41f0-9470-9601f1bc8a08 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 287 microversion: 2.1 time: 0.034689 Aug 24 06:53:10.687989 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 565/1158] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:10 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:10.699372 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c20b16b9-3a3d-460e-9ce7-fab110e0f0c2 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d4615280>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:10.806802 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c20b16b9-3a3d-460e-9ce7-fab110e0f0c2 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 202 len: 0 microversion: 2.1 time: 0.111714 Aug 24 06:53:10.807363 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 594/1159] 10.222.0.47 () {58 vars in 1254 bytes} [Wed Aug 24 06:53:10 2022] DELETE /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:53:10.815654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-53ffaa8e-2802-4b3a-ba10-155d1773a490 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d44f0790>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:10.846481 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-53ffaa8e-2802-4b3a-ba10-155d1773a490 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.034558 Aug 24 06:53:10.847046 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 566/1160] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:10 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:53:11.859631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2335bd0c-fef7-46ab-a37f-94ed20f4c00f tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d47b1dc0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:11.889550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2335bd0c-fef7-46ab-a37f-94ed20f4c00f tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.034920 Aug 24 06:53:11.890144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 595/1161] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:11 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:12.902618 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5408ca47-6a3f-42ea-9030-b9bfbb811084 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d46aa790>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:12.932199 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5408ca47-6a3f-42ea-9030-b9bfbb811084 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.034216 Aug 24 06:53:12.933538 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 567/1162] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:12 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:13.947093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6c3555eb-b3d7-42b1-8abf-f9fc5cbd3f2e tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d472cf70>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:13.980605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6c3555eb-b3d7-42b1-8abf-f9fc5cbd3f2e tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.035488 Aug 24 06:53:13.980605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 596/1163] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:13 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:14.991632 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8726bf7d-d6a6-4dea-95ab-84003b227e9f tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d45318b0>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:15.021710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8726bf7d-d6a6-4dea-95ab-84003b227e9f tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 200 len: 286 microversion: 2.1 time: 0.034626 Aug 24 06:53:15.022323 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 568/1164] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:14 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:16.034774 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4ec177d0-d8f3-40df-b55a-23691b65d8fb tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d4653af0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:16.059890 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-4ec177d0-d8f3-40df-b55a-23691b65d8fb tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] HTTP exception thrown: Snapshot fc77e7c6-e859-459f-876e-5cb3ad277312 could not be found. Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4ec177d0-d8f3-40df-b55a-23691b65d8fb tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Request method failure captured: Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 HTTP/1.1 Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcrK9wqofdIBnID0pO5a4jUloafxBc68a8hGGNp07QVpd8Ke1sXTA4kWmJWxb9EvXRzYaQj1kH10a0PGtzc9ow9FCBqk8K6uryl6iMrydQhTsjW1aUn6VbaCBmD7Kq56BAwIywncKWlLiASpRIxyvQiV7h6frmVXz_euxa4B4WsEZow Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 2689efdab9f440b5a928a6ce643c4f69 Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:53:16.063056 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2689efdab9f440b5a928a6ce643c4f69", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 2689efdab9f440b5a928a6ce643c4f69 Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-VolumesSnapshotsTestJSON-388089952-project Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 672493753ec34139a94535e528896165 Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-388089952-project Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Snapshot fc77e7c6-e859-459f-876e-5cb3ad277312 could not be found. Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': 'fc77e7c6-e859-459f-876e-5cb3ad277312'} Aug 24 06:53:16.064737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fc77e7c6-e859-459f-876e-5cb3ad277312 could not be found. (HTTP 404) (Request-ID: req-8e0c46d8-bbfa-4544-83af-b68c0e1cc00f) Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:16.066085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:53:16.067560 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fc77e7c6-e859-459f-876e-5cb3ad277312 could not be found. Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 06:53:16.069115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fc77e7c6-e859-459f-876e-5cb3ad277312 could not be found. Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fc77e7c6-e859-459f-876e-5cb3ad277312 could not be found. Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4ec177d0-d8f3-40df-b55a-23691b65d8fb tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Returning 404 to user: Snapshot fc77e7c6-e859-459f-876e-5cb3ad277312 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:53:16.078881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4ec177d0-d8f3-40df-b55a-23691b65d8fb tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312" status: 404 len: 111 microversion: 2.1 time: 0.034067 Aug 24 06:53:16.080511 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 597/1165] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:53:16 2022] GET /compute/v2.1/os-snapshots/fc77e7c6-e859-459f-876e-5cb3ad277312 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:53:16.080663 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6721ccd2-0c33-48c0-8d29-054f64fa7e9e tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d46f8040>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:16.251530 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6721ccd2-0c33-48c0-8d29-054f64fa7e9e tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447" status: 202 len: 0 microversion: 2.1 time: 0.181961 Aug 24 06:53:16.252099 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 569/1166] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:53:16 2022] DELETE /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:53:16.261115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3a9ebcd8-8229-4c9d-80c5-96c41ac15112 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d477c0d0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:16.310902 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3a9ebcd8-8229-4c9d-80c5-96c41ac15112 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447" status: 200 len: 344 microversion: 2.1 time: 0.054481 Aug 24 06:53:16.315857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 598/1167] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:53:16 2022] GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:17.327626 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c2f350ee-a912-4c79-a494-3848a80826fd tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d448af70>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:17.368749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-c2f350ee-a912-4c79-a494-3848a80826fd tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] HTTP exception thrown: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c2f350ee-a912-4c79-a494-3848a80826fd tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Request method failure captured: Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 HTTP/1.1 Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcrK9wqofdIBnID0pO5a4jUloafxBc68a8hGGNp07QVpd8Ke1sXTA4kWmJWxb9EvXRzYaQj1kH10a0PGtzc9ow9FCBqk8K6uryl6iMrydQhTsjW1aUn6VbaCBmD7Kq56BAwIywncKWlLiASpRIxyvQiV7h6frmVXz_euxa4B4WsEZow Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 2689efdab9f440b5a928a6ce643c4f69 Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:53:17.371937 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2689efdab9f440b5a928a6ce643c4f69", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 2689efdab9f440b5a928a6ce643c4f69 Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesSnapshotsTestJSON-388089952-project Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 672493753ec34139a94535e528896165 Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesSnapshotsTestJSON-388089952-project Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '6160402a-9517-4ed4-8527-948e7f6c2447'} Aug 24 06:53:17.373909 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. (HTTP 404) (Request-ID: req-09436a24-a219-423e-9f93-2532c66c515b) Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:17.374818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:53:17.376186 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:53:17.377877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c2f350ee-a912-4c79-a494-3848a80826fd tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Returning 404 to user: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c2f350ee-a912-4c79-a494-3848a80826fd tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447" status: 404 len: 109 microversion: 2.1 time: 0.052299 Aug 24 06:53:17.379422 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 570/1168] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:53:17 2022] GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:53:17.391919 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4f148e09-9d1c-423b-83a9-51bffc838406 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d472c1f0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:17.421677 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-4f148e09-9d1c-423b-83a9-51bffc838406 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] HTTP exception thrown: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4f148e09-9d1c-423b-83a9-51bffc838406 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Request method failure captured: Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: DELETE /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 HTTP/1.1 Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBcrK9wqofdIBnID0pO5a4jUloafxBc68a8hGGNp07QVpd8Ke1sXTA4kWmJWxb9EvXRzYaQj1kH10a0PGtzc9ow9FCBqk8K6uryl6iMrydQhTsjW1aUn6VbaCBmD7Kq56BAwIywncKWlLiASpRIxyvQiV7h6frmVXz_euxa4B4WsEZow Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: 2689efdab9f440b5a928a6ce643c4f69 Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:53:17.423992 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2689efdab9f440b5a928a6ce643c4f69", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: 2689efdab9f440b5a928a6ce643c4f69 Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-VolumesSnapshotsTestJSON-388089952-project Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 672493753ec34139a94535e528896165 Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-388089952-project Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '6160402a-9517-4ed4-8527-948e7f6c2447'} Aug 24 06:53:17.425667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. (HTTP 404) (Request-ID: req-fe9477a8-7550-4a9e-9972-6fa6a676db98) Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:17.426659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:53:17.428403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 06:53:17.429930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4f148e09-9d1c-423b-83a9-51bffc838406 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Returning 404 to user: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4f148e09-9d1c-423b-83a9-51bffc838406 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447" status: 404 len: 109 microversion: 2.1 time: 0.038475 Aug 24 06:53:17.431347 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 599/1169] 10.222.0.47 () {58 vars in 1248 bytes} [Wed Aug 24 06:53:17 2022] DELETE /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:53:17.435028 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-715b4975-fc53-40fd-ab8c-227d68b6d287 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Calling method '.version_select at 0x7fb5d4421dc0>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:17.463491 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-715b4975-fc53-40fd-ab8c-227d68b6d287 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] HTTP exception thrown: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-715b4975-fc53-40fd-ab8c-227d68b6d287 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Request method failure captured: Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 HTTP/1.1 Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcrK9wqofdIBnID0pO5a4jUloafxBc68a8hGGNp07QVpd8Ke1sXTA4kWmJWxb9EvXRzYaQj1kH10a0PGtzc9ow9FCBqk8K6uryl6iMrydQhTsjW1aUn6VbaCBmD7Kq56BAwIywncKWlLiASpRIxyvQiV7h6frmVXz_euxa4B4WsEZow Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 2689efdab9f440b5a928a6ce643c4f69 Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:53:17.465533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2689efdab9f440b5a928a6ce643c4f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2689efdab9f440b5a928a6ce643c4f69", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 2689efdab9f440b5a928a6ce643c4f69 Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-388089952 Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesSnapshotsTestJSON-388089952-project Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 672493753ec34139a94535e528896165 Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesSnapshotsTestJSON-388089952-project Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '6160402a-9517-4ed4-8527-948e7f6c2447'} Aug 24 06:53:17.467152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. (HTTP 404) (Request-ID: req-5e96ea8d-67ad-41a7-bae3-4515981771f4) Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:17.468256 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:53:17.469479 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:53:17.470627 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-715b4975-fc53-40fd-ab8c-227d68b6d287 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] Returning 404 to user: Volume 6160402a-9517-4ed4-8527-948e7f6c2447 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-715b4975-fc53-40fd-ab8c-227d68b6d287 tempest-VolumesSnapshotsTestJSON-388089952 tempest-VolumesSnapshotsTestJSON-388089952-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447" status: 404 len: 109 microversion: 2.1 time: 0.036789 Aug 24 06:53:17.471913 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 571/1170] 10.222.0.47 () {58 vars in 1245 bytes} [Wed Aug 24 06:53:17 2022] GET /compute/v2.1/os-volumes/6160402a-9517-4ed4-8527-948e7f6c2447 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:53:24.939341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-306702576", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-277619539", "security_groups": [{"name": "tempest-secgroup-smoke-958460855"}], "networks": [{"uuid": "f83d5277-ad07-43c7-a753-9df151dd22c3"}], "block_device_mapping_v2": [{"uuid": "7ee73ac1-6faa-45e8-867f-d4d15fbf3472", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:25.090767 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] validate_networks() for [('f83d5277-ad07-43c7-a753-9df151dd22c3', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:53:25.808855 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:53:25.809584 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:53:25.810052 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:53:25.810454 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:53:25.810856 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:53:25.820260 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:25.820732 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:25.821155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:25.821893 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:25.822329 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:25.822772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:25.842828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Getting quotas for project 0cc00174433b49a2980339c2963671b0. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:53:25.849008 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Getting quotas for user 2e6e7001705b47a09b6e5d7f08595fc8 and project 0cc00174433b49a2980339c2963671b0. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:53:25.934174 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:53:25.937779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ee73ac1-6faa-45e8-867f-d4d15fbf3472',volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:53:26.356142 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:26.356871 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:26.366151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:26.366904 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:26.367407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:26.368543 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:26.368673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:26.369163 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:26.398035 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:53:26.579636 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-2beab88d-fe15-43e0-be19-3dc89310098e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.645219 Aug 24 06:53:26.582973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 600/1171] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:53:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:53:26.595377 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-ddaf8f53-eb70-4c37-8e4d-f4830570a4d7 req-8c3befb9-27e1-434e-ab48-13bd32b1c4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c89f8cf-aaa8-43d8-b632-88ecd0690a8a", "tag": "bc6fe70d-98e9-4938-bfac-e7e933f3b282"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:26.612456 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-ddaf8f53-eb70-4c37-8e4d-f4830570a4d7 req-8c3befb9-27e1-434e-ab48-13bd32b1c4df service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:26.614741 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-ddaf8f53-eb70-4c37-8e4d-f4830570a4d7 req-8c3befb9-27e1-434e-ab48-13bd32b1c4df service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:26.614741 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-ddaf8f53-eb70-4c37-8e4d-f4830570a4d7 req-8c3befb9-27e1-434e-ab48-13bd32b1c4df service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:26.629139 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-ddaf8f53-eb70-4c37-8e4d-f4830570a4d7 req-8c3befb9-27e1-434e-ab48-13bd32b1c4df service nova] Creating event network-changed:bc6fe70d-98e9-4938-bfac-e7e933f3b282 for instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a on hv-cinder-85427 Aug 24 06:53:26.637163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-ddaf8f53-eb70-4c37-8e4d-f4830570a4d7 req-8c3befb9-27e1-434e-ab48-13bd32b1c4df service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050616 Aug 24 06:53:26.638765 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 601/1172] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:26.646296 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4eb49f6a-69f1-48c2-9029-52194cffca11 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:26.649127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4eb49f6a-69f1-48c2-9029-52194cffca11 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:26.711177 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4eb49f6a-69f1-48c2-9029-52194cffca11 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:26.720743 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4eb49f6a-69f1-48c2-9029-52194cffca11 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1087 microversion: 2.1 time: 0.080341 Aug 24 06:53:26.721344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 602/1173] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:26 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1087 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:26.754427 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-8fa0da02-44cf-41b2-9d47-e6fce3e3eacd tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 204 len: 0 microversion: 2.1 time: 0.403951 Aug 24 06:53:26.755386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 572/1174] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:53:26 2022] DELETE /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:53:26.769599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:26.770422 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:26.780657 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:26.781159 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:26.782090 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:26.782810 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:26.783368 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:26.783966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:27.008007 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:27.019354 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cd763efe-9e2a-4d2d-b746-88fb6ee9cf70 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1579 microversion: 2.1 time: 0.253420 Aug 24 06:53:27.020163 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 603/1175] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:26 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1579 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:27.743281 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-33ffcb6f-b765-4a45-87c2-96e4dcee736b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:27.743988 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-33ffcb6f-b765-4a45-87c2-96e4dcee736b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:27.831943 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-33ffcb6f-b765-4a45-87c2-96e4dcee736b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:27.842539 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-33ffcb6f-b765-4a45-87c2-96e4dcee736b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1087 microversion: 2.1 time: 0.103499 Aug 24 06:53:27.844036 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 573/1176] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:27 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1087 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:28.042399 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:28.043142 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:28.050748 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:28.051229 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:28.051660 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:28.052510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:28.053145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:28.053598 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:28.200842 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:28.208749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-23ea168b-190e-440b-bf53-853ebecf8f56 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1579 microversion: 2.1 time: 0.171079 Aug 24 06:53:28.210094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 604/1177] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:28 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:28.870979 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:28.874132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:28.888056 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:28.889560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:28.890571 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:28.891814 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:28.892754 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:28.893556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:29.008925 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:29.025449 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cdf7a182-acf0-496c-acb4-d18bcc634a85 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1129 microversion: 2.1 time: 0.162885 Aug 24 06:53:29.028560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 574/1178] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:28 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1129 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:29.233145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:29.234987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:29.242809 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:29.243806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:29.244592 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:29.245552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:29.246272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:29.248027 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:29.321494 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:29.331828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c8230ed5-2b59-42c6-a88a-1d55622626da tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1392 microversion: 2.1 time: 0.103425 Aug 24 06:53:29.332784 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 605/1179] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:29 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1392 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:29.366289 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-0583e970-ffc9-41e0-9027-b5346a31a545 req-3915f2d1-b201-45d4-8fe3-8a6419993024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c89f8cf-aaa8-43d8-b632-88ecd0690a8a", "name": "network-vif-deleted", "tag": "bc6fe70d-98e9-4938-bfac-e7e933f3b282"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:29.381942 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-0583e970-ffc9-41e0-9027-b5346a31a545 req-3915f2d1-b201-45d4-8fe3-8a6419993024 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:29.382647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-0583e970-ffc9-41e0-9027-b5346a31a545 req-3915f2d1-b201-45d4-8fe3-8a6419993024 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:29.383234 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-0583e970-ffc9-41e0-9027-b5346a31a545 req-3915f2d1-b201-45d4-8fe3-8a6419993024 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:29.396376 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-0583e970-ffc9-41e0-9027-b5346a31a545 req-3915f2d1-b201-45d4-8fe3-8a6419993024 service nova] Creating event network-vif-deleted:bc6fe70d-98e9-4938-bfac-e7e933f3b282 for instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a on hv-cinder-85427 Aug 24 06:53:29.402100 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-0583e970-ffc9-41e0-9027-b5346a31a545 req-3915f2d1-b201-45d4-8fe3-8a6419993024 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040471 Aug 24 06:53:29.402992 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 575/1180] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:30.049151 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:30.049899 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:30.055978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:30.063165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:30.063165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:30.063165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:30.063165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:30.063789 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:30.142157 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:30.152195 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-43a9f808-fa58-4f14-8860-047355bf57a2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1203 microversion: 2.1 time: 0.107243 Aug 24 06:53:30.161213 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 606/1181] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:30 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1203 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:30.358673 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:30.359421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:30.365639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:30.366126 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:30.366630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:30.367278 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:30.367735 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:30.368194 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:30.400946 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:30.401455 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:30.403939 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:30.403939 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lazy-loading 'fault' on Instance uuid 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:53:30.452029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:30.460205 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-f634cd76-f7a5-42ad-94c1-fcaeb1d6d46d tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 200 len: 1230 microversion: 2.1 time: 0.107299 Aug 24 06:53:30.460791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 576/1182] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:30 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:31.177974 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:31.178930 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:31.192141 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:31.192940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:31.193604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:31.194643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:31.195379 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:31.196073 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:31.358234 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:31.366699 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-fbcf5476-3179-41c2-868a-bf848e2238d8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1270 microversion: 2.1 time: 0.194555 Aug 24 06:53:31.367269 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 607/1183] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:31 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:31.483704 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:31.484397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:31.491000 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:31.491485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:31.491923 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:31.492625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:31.493084 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:31.493696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:31.509532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] HTTP exception thrown: Instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a could not be found. Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Request method failure captured: Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a HTTP/1.1 Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBchkSl4oz5nY3GuAuyFTXBSXbOhabGlIuSSWl3zqKGvC44Qyb9ZYmrnMJ2z5wHu-GuZoz7oATwKWC099aeY4NPDNlx2gsQvrG2lJHV_SnbqM9Cj1icV-GWyXT0OrTSzFZau4IMHss-TobIDvEK0gqhSt0R1Y6WlQE89b5IpiTOZEvWg Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: a97277d100304d6aa689f73174562474 Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:53:31.512016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a97277d100304d6aa689f73174562474"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a97277d100304d6aa689f73174562474", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: a97277d100304d6aa689f73174562474 Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 594e9324c44540568a81fd5fdb980efb Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a could not be found. Aug 24 06:53:31.519207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '4c89f8cf-aaa8-43d8-b632-88ecd0690a8a'} Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a could not be found. Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:53:31.520151 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a could not be found. Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a could not be found. Aug 24 06:53:31.521485 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:31.522891 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Returning 404 to user: Instance 4c89f8cf-aaa8-43d8-b632-88ecd0690a8a could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:53:31.522891 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-44827233-e52b-4bfb-afa9-f4584cd497fa tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a" status: 404 len: 111 microversion: 2.1 time: 0.035105 Aug 24 06:53:31.522891 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 577/1184] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:31 2022] GET /compute/v2.1/servers/4c89f8cf-aaa8-43d8-b632-88ecd0690a8a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:53:31.863059 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-4d4e1253-5178-46e1-b26f-9d9b76e35a1b req-cf99be80-b486-4c22-865b-bd783ae68f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f3238d-9433-4c26-b0f3-6b3699264721", "tag": "3cbe7c52-b66d-42ce-a944-01967a8d9f64"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:31.876627 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-4d4e1253-5178-46e1-b26f-9d9b76e35a1b req-cf99be80-b486-4c22-865b-bd783ae68f86 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:31.877099 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-4d4e1253-5178-46e1-b26f-9d9b76e35a1b req-cf99be80-b486-4c22-865b-bd783ae68f86 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:31.877546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-4d4e1253-5178-46e1-b26f-9d9b76e35a1b req-cf99be80-b486-4c22-865b-bd783ae68f86 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:31.889935 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-4d4e1253-5178-46e1-b26f-9d9b76e35a1b req-cf99be80-b486-4c22-865b-bd783ae68f86 service nova] Creating event network-changed:3cbe7c52-b66d-42ce-a944-01967a8d9f64 for instance d9f3238d-9433-4c26-b0f3-6b3699264721 on hv-cinder-85427 Aug 24 06:53:31.895053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-4d4e1253-5178-46e1-b26f-9d9b76e35a1b req-cf99be80-b486-4c22-865b-bd783ae68f86 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035801 Aug 24 06:53:31.901042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 608/1185] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:32.388959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:32.395192 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:32.395741 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:32.396432 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:32.396968 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:32.397772 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:32.398230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:32.398646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:32.645251 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:32.656571 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2e71a684-c643-4aed-9c8b-144c5e1e7f73 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.272389 Aug 24 06:53:32.657168 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 578/1186] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:32 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:33.679403 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:33.680743 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:33.688012 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:33.688489 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:33.691200 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:33.691200 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:33.691200 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:33.691200 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:33.857630 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:33.865686 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-72efd5a4-72ee-4276-8227-64f9ca497f08 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.191229 Aug 24 06:53:33.866325 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 609/1187] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:33 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:34.889967 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:34.891803 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:34.898970 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:34.899532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:34.899966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:34.901318 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:34.902207 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:34.902339 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.183082 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:35.183082 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:35.189359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:35.189841 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:35.191274 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.191987 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:35.192498 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:35.193346 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:35.195075 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.206713 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a7c791ba-89c6-4358-8132-ce02587e46cb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.323613 Aug 24 06:53:35.207560 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 579/1188] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:34 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:35.215506 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-49e5fb75-4038-4fd0-af46-407a7962ffa3 req-135cdfd6-25c5-4b78-b83d-78a6a00514f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e19365c-8664-4f9a-bd20-ff53faa8f495", "tag": "83213354-63ee-4dfa-bbb7-7105246d4dc8"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:35.226933 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-49e5fb75-4038-4fd0-af46-407a7962ffa3 req-135cdfd6-25c5-4b78-b83d-78a6a00514f7 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:35.227902 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-49e5fb75-4038-4fd0-af46-407a7962ffa3 req-135cdfd6-25c5-4b78-b83d-78a6a00514f7 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:35.228498 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-49e5fb75-4038-4fd0-af46-407a7962ffa3 req-135cdfd6-25c5-4b78-b83d-78a6a00514f7 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.243726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:53:35.245690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-49e5fb75-4038-4fd0-af46-407a7962ffa3 req-135cdfd6-25c5-4b78-b83d-78a6a00514f7 service nova] Creating event network-changed:83213354-63ee-4dfa-bbb7-7105246d4dc8 for instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 on hv-cinder-85427 Aug 24 06:53:35.252567 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-49e5fb75-4038-4fd0-af46-407a7962ffa3 req-135cdfd6-25c5-4b78-b83d-78a6a00514f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042405 Aug 24 06:53:35.253708 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 580/1189] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:35.679928 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-99b9860e-f1cf-4fa8-8d18-79acf40ea61a tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 204 len: 0 microversion: 2.1 time: 0.501326 Aug 24 06:53:35.682115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 610/1190] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:53:35 2022] DELETE /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:53:35.691747 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:35.692643 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:35.701115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:35.701997 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:35.702607 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.703539 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:35.704166 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:35.704758 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.976160 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:35.986665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2625ea7f-cc91-48b2-89cc-8e1892141335 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1578 microversion: 2.1 time: 0.300958 Aug 24 06:53:35.987944 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 581/1191] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:35 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1578 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:36.231513 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:36.232304 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:36.235684 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:36.244912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:36.244912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:36.244912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:36.244912 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:36.246740 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:36.246740 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:36.402781 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:36.410977 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6a9c6e96-8036-48e0-91a2-be96cfc08d69 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.184412 Aug 24 06:53:36.411469 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 611/1192] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:36 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:37.008658 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:37.014405 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:37.017024 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:37.017646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:37.018178 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:37.019113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:37.019645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:37.020132 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:37.093377 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:37.101550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d2577493-d96f-4583-80ec-9714ca22a813 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1392 microversion: 2.1 time: 0.097221 Aug 24 06:53:37.102124 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 582/1193] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:37 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1392 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:37.268471 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-af6bd919-106e-49e4-ad67-2aa481f4d746 req-45cd337d-2b3e-4e15-b896-ef6782de0072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e19365c-8664-4f9a-bd20-ff53faa8f495", "name": "network-vif-deleted", "tag": "83213354-63ee-4dfa-bbb7-7105246d4dc8"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:37.273542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=8 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:37.280419 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-af6bd919-106e-49e4-ad67-2aa481f4d746 req-45cd337d-2b3e-4e15-b896-ef6782de0072 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:37.281217 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-af6bd919-106e-49e4-ad67-2aa481f4d746 req-45cd337d-2b3e-4e15-b896-ef6782de0072 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:37.281843 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-af6bd919-106e-49e4-ad67-2aa481f4d746 req-45cd337d-2b3e-4e15-b896-ef6782de0072 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:37.294966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-af6bd919-106e-49e4-ad67-2aa481f4d746 req-45cd337d-2b3e-4e15-b896-ef6782de0072 service nova] Creating event network-vif-deleted:83213354-63ee-4dfa-bbb7-7105246d4dc8 for instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 on hv-cinder-85427 Aug 24 06:53:37.299907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-af6bd919-106e-49e4-ad67-2aa481f4d746 req-45cd337d-2b3e-4e15-b896-ef6782de0072 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035296 Aug 24 06:53:37.300670 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 612/1194] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:37.434155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:37.435066 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:37.441159 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:37.441675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:37.442109 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:37.442843 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:37.443294 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:37.444421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:37.599795 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:37.608707 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cabe8a32-5c63-4143-87a7-5befc8d39c8b tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.179296 Aug 24 06:53:37.609736 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 583/1195] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:37 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:38.125258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:38.125965 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:38.132978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:38.133743 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:38.134176 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:38.134874 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:38.135330 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:38.135755 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:38.174132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:38.174482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:38.174944 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:38.175318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lazy-loading 'fault' on Instance uuid 8e19365c-8664-4f9a-bd20-ff53faa8f495 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:53:38.219143 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:38.226926 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5f528188-c5af-42f4-bde3-f6103945eb93 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1231 microversion: 2.1 time: 0.107080 Aug 24 06:53:38.227413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 613/1196] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:38 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:38.630446 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:38.631129 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:38.633144 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:38.639550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:38.640037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:38.640468 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:38.641159 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:38.641632 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:38.642050 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:38.780567 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:38.788179 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-b0fbe2db-db84-4105-bd0d-7cd697cf1c5c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.161599 Aug 24 06:53:38.788741 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 584/1197] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:38 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:39.248236 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:39.248960 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:39.255660 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:39.256162 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:39.256790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:39.258861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:39.258861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:39.258861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:39.292234 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:39.293476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:39.294145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:39.294588 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lazy-loading 'fault' on Instance uuid 8e19365c-8664-4f9a-bd20-ff53faa8f495 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:53:39.340679 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '594e9324c44540568a81fd5fdb980efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97277d100304d6aa689f73174562474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:39.348626 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4e69f63e-2568-4537-9ddd-cc81dc0595c1 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 200 len: 1231 microversion: 2.1 time: 0.104478 Aug 24 06:53:39.349208 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 614/1198] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:39 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:39.810700 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:39.811312 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:39.818532 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:39.819047 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:39.819584 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:39.820272 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:39.820748 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:39.821510 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:39.961494 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:39.970179 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-e18cecc5-7910-49de-a885-573705f105a5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.164019 Aug 24 06:53:39.971127 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 585/1199] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:39 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:40.370115 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:40.370724 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: 8e19365c-8664-4f9a-bd20-ff53faa8f495] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:40.378173 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:40.378733 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:40.379143 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:40.379843 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:40.380459 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:40.380884 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:40.394934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.wsgi [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] HTTP exception thrown: Instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 could not be found. Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Request method failure captured: Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: request: GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 HTTP/1.1 Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept: application/json Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Accept-Encoding: identity Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Connection: close Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Length: 0 Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Content-Type: application/json Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Host: 10.222.0.47 Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Openstack-System-Scope: None Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: User-Agent: python-urllib3/1.26.11 Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Auth-Token: gAAAAABjBchkSl4oz5nY3GuAuyFTXBSXbOhabGlIuSSWl3zqKGvC44Qyb9ZYmrnMJ2z5wHu-GuZoz7oATwKWC099aeY4NPDNlx2gsQvrG2lJHV_SnbqM9Cj1icV-GWyXT0OrTSzFZau4IMHss-TobIDvEK0gqhSt0R1Y6WlQE89b5IpiTOZEvWg Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Id: None Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Domain-Name: None Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Identity-Status: Confirmed Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Is-Admin-Project: True Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Id: default Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Domain-Name: Default Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Id: a97277d100304d6aa689f73174562474 Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Project-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Role: reader,member Aug 24 06:53:40.396603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Roles: reader,member Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a97277d100304d6aa689f73174562474"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a97277d100304d6aa689f73174562474", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Id: a97277d100304d6aa689f73174562474 Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Id: default Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Domain-Name: Default Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Id: 594e9324c44540568a81fd5fdb980efb Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: X-User-Name: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: method: > Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: exception: Instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 could not be found. Aug 24 06:53:40.398201 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: action_args: {'id': '8e19365c-8664-4f9a-bd20-ff53faa8f495'} Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 could not be found. Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:53:40.399100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 could not be found. Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 could not be found. Aug 24 06:53:40.400344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.401749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Returning 404 to user: Instance 8e19365c-8664-4f9a-bd20-ff53faa8f495 could not be found. {{(pid=127727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:53:40.401749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-412b34fc-08e0-4065-9639-61720d569144 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495" status: 404 len: 111 microversion: 2.1 time: 0.031863 Aug 24 06:53:40.401749 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 615/1200] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:40 2022] GET /compute/v2.1/servers/8e19365c-8664-4f9a-bd20-ff53faa8f495 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:53:40.960945 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:40.961574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:40.969366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:40.970351 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:40.970351 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:40.971164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:40.971614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:40.972032 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:40.988002 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] HTTP exception thrown: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Request method failure captured: Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: DELETE /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 HTTP/1.1 Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBchkSl4oz5nY3GuAuyFTXBSXbOhabGlIuSSWl3zqKGvC44Qyb9ZYmrnMJ2z5wHu-GuZoz7oATwKWC099aeY4NPDNlx2gsQvrG2lJHV_SnbqM9Cj1icV-GWyXT0OrTSzFZau4IMHss-TobIDvEK0gqhSt0R1Y6WlQE89b5IpiTOZEvWg Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: a97277d100304d6aa689f73174562474 Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:53:40.990966 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a97277d100304d6aa689f73174562474"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a97277d100304d6aa689f73174562474", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: a97277d100304d6aa689f73174562474 Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 594e9324c44540568a81fd5fdb980efb Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:40.992654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4'} Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:53:40.993558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:40.994841 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:40.996675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Returning 404 to user: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:53:40.996675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7e06d909-fb13-4ae3-9790-daf5198c2fde tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 404 len: 111 microversion: 2.1 time: 0.035339 Aug 24 06:53:40.996675 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 586/1201] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:53:40 2022] DELETE /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:53:40.997055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:40.998142 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:41.002779 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:41.003461 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] [instance: e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:41.006110 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:41.006810 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:41.007418 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:41.008390 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:41.008966 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:41.009639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:41.009783 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:41.010071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:41.010453 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:41.011148 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:41.011604 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:41.012024 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:41.026868 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] HTTP exception thrown: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Request method failure captured: Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 HTTP/1.1 Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBchkSl4oz5nY3GuAuyFTXBSXbOhabGlIuSSWl3zqKGvC44Qyb9ZYmrnMJ2z5wHu-GuZoz7oATwKWC099aeY4NPDNlx2gsQvrG2lJHV_SnbqM9Cj1icV-GWyXT0OrTSzFZau4IMHss-TobIDvEK0gqhSt0R1Y6WlQE89b5IpiTOZEvWg Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: a97277d100304d6aa689f73174562474 Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:53:41.028470 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a97277d100304d6aa689f73174562474"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a97277d100304d6aa689f73174562474"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a97277d100304d6aa689f73174562474", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: a97277d100304d6aa689f73174562474 Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504463952 Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 594e9324c44540568a81fd5fdb980efb Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-TestVolumeBootPattern-1504463952-project Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:41.030172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4'} Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:53:41.031788 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. Aug 24 06:53:41.033145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:53:41.034489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Returning 404 to user: Instance e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:53:41.034489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5bebbb98-0759-4735-aa36-1012b7992f14 tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4" status: 404 len: 111 microversion: 2.1 time: 0.032654 Aug 24 06:53:41.034489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 587/1202] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:40 2022] GET /compute/v2.1/servers/e9c1ed85-e4ed-4fcc-a98c-e7a7eb63e7d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:53:41.156188 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:41.164698 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-431c0140-7c40-4388-8012-0d84c8b7d9fb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.177515 Aug 24 06:53:41.172283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 616/1203] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:40 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:42.188886 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:42.189603 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:42.196243 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:42.196749 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:42.197197 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:42.197893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:42.198340 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:42.198759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:42.344105 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:42.348082 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-ab847db9-5b6d-4496-b4db-e36033c161ba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.164824 Aug 24 06:53:42.348193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 588/1204] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:42 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:42.681360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0152bfa1-af38-4ecc-8fa2-e72866a697cc tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] Calling method '.version_select at 0x7fb5d46c05e0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:42.777736 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0152bfa1-af38-4ecc-8fa2-e72866a697cc tempest-TestVolumeBootPattern-1504463952 tempest-TestVolumeBootPattern-1504463952-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1329256554" status: 202 len: 0 microversion: 2.1 time: 0.102430 Aug 24 06:53:42.778324 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 617/1205] 10.222.0.47 () {58 vars in 1263 bytes} [Wed Aug 24 06:53:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1329256554 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:53:43.369475 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:43.370098 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:43.376553 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:43.377042 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:43.377505 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:43.378198 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:43.378648 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:43.379075 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:43.528652 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:43.538307 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-574877a4-bfe6-4210-909c-b69887e461cd tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.172714 Aug 24 06:53:43.539363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 589/1206] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:43 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:43.677720 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-82348fb3-029a-4c61-8275-515c1d33a358 req-5e12a324-0e08-4997-a32b-b484a3958aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f3238d-9433-4c26-b0f3-6b3699264721", "name": "network-vif-plugged", "status": "completed", "tag": "3cbe7c52-b66d-42ce-a944-01967a8d9f64"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:43.688228 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-82348fb3-029a-4c61-8275-515c1d33a358 req-5e12a324-0e08-4997-a32b-b484a3958aef service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:43.688879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-82348fb3-029a-4c61-8275-515c1d33a358 req-5e12a324-0e08-4997-a32b-b484a3958aef service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:43.689125 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-82348fb3-029a-4c61-8275-515c1d33a358 req-5e12a324-0e08-4997-a32b-b484a3958aef service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:43.701376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-82348fb3-029a-4c61-8275-515c1d33a358 req-5e12a324-0e08-4997-a32b-b484a3958aef service nova] Creating event network-vif-plugged:3cbe7c52-b66d-42ce-a944-01967a8d9f64 for instance d9f3238d-9433-4c26-b0f3-6b3699264721 on hv-cinder-85427 Aug 24 06:53:43.708444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-82348fb3-029a-4c61-8275-515c1d33a358 req-5e12a324-0e08-4997-a32b-b484a3958aef service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188777 Aug 24 06:53:43.709758 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 618/1207] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:53:44.565564 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:44.565564 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:44.582407 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:44.582797 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:44.583447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:44.584327 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:44.586498 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:44.587096 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:44.835152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:44.845328 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:44.847520 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cbecf28e-057a-4354-b77f-ee41a15e5b31 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1258 microversion: 2.1 time: 0.288992 Aug 24 06:53:44.848603 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 590/1208] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:44 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1258 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:45.869689 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:45.871304 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:45.879465 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:45.879955 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:45.880394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:45.881311 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:45.881766 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:45.882373 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:46.065860 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:46.074039 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-449a292c-9be1-4634-ac79-0851545906f0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1442 microversion: 2.1 time: 0.208889 Aug 24 06:53:46.074604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 619/1209] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:45 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1442 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:46.097910 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:46.098667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:46.106893 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:46.107823 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:46.109982 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:46.111761 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:46.112728 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:46.113444 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:46.361007 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:46.375597 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-376ba762-c472-4c1b-b50e-bb6425efd434 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1442 microversion: 2.1 time: 0.281726 Aug 24 06:53:46.376432 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 591/1210] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:46 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1442 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:49.507772 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-61bb32e2-be1a-44f1-8c92-a76186a116ac req-99164986-9a8c-4046-a20c-7c80a83c233c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f3238d-9433-4c26-b0f3-6b3699264721", "tag": "3cbe7c52-b66d-42ce-a944-01967a8d9f64"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:49.522514 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-61bb32e2-be1a-44f1-8c92-a76186a116ac req-99164986-9a8c-4046-a20c-7c80a83c233c service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:49.523287 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-61bb32e2-be1a-44f1-8c92-a76186a116ac req-99164986-9a8c-4046-a20c-7c80a83c233c service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:49.524065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-61bb32e2-be1a-44f1-8c92-a76186a116ac req-99164986-9a8c-4046-a20c-7c80a83c233c service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:49.529448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:49.540164 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-61bb32e2-be1a-44f1-8c92-a76186a116ac req-99164986-9a8c-4046-a20c-7c80a83c233c service nova] Creating event network-changed:3cbe7c52-b66d-42ce-a944-01967a8d9f64 for instance d9f3238d-9433-4c26-b0f3-6b3699264721 on hv-cinder-85427 Aug 24 06:53:49.562292 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-61bb32e2-be1a-44f1-8c92-a76186a116ac req-99164986-9a8c-4046-a20c-7c80a83c233c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059173 Aug 24 06:53:49.564570 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 620/1211] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:35.910978 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2002910", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "networks": [{"uuid": "2f7f46d8-77e7-438e-a474-5c38bb877f48"}]}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:54:35.919763 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:35.965216 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.network.neutron [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] validate_networks() for [('2f7f46d8-77e7-438e-a474-5c38bb877f48', None, None, None, None, None)] {{(pid=127728) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:54:36.392864 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Flavor limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:54:36.393465 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Image limits 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:54:36.394296 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Flavor pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:54:36.394717 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Image pref 0:0:0 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:54:36.395125 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.virt.hardware [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:54:36.404614 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:36.405082 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:36.405537 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:36.406326 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:36.406765 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:36.407180 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:36.425335 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Getting quotas for project e443552ae9eb446a94665b5674b57f15. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:54:36.430138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.quota [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Getting quotas for user 8bc75750fe3348c18cde49a64456f879 and project e443552ae9eb446a94665b5674b57f15. Resources: {'cores', 'instances', 'ram'} {{(pid=127728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:54:36.441371 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Going to run 1 instances... {{(pid=127728) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:54:36.443755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:54:36.560322 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-891306ff-d29f-4e7b-8e3c-824657f72e1b tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653376 Aug 24 06:54:36.560989 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 592/1212] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:54:36.570196 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:36.574359 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b42281ad-f770-49fb-add2-bc32a03dad68 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:36.575055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b42281ad-f770-49fb-add2-bc32a03dad68 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:36.649414 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b42281ad-f770-49fb-add2-bc32a03dad68 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:36.657311 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b42281ad-f770-49fb-add2-bc32a03dad68 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1216 microversion: 2.1 time: 0.089143 Aug 24 06:54:36.657871 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 621/1213] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:36 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:54:37.678646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:37.679261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:37.686590 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:37.687113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:37.687550 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:37.688254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:37.688744 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:37.689317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:37.755166 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:37.763577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9b4304a7-16bd-45aa-b746-3d67bba06e50 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1220 microversion: 2.1 time: 0.089516 Aug 24 06:54:37.764165 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 593/1214] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:37 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:38.784374 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:38.785260 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:38.793996 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:38.794836 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:38.794986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:38.795770 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:38.796214 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:38.797131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:38.864061 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:38.873073 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-b556a752-3278-4d29-bf78-53c5f0f3bcbd tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1268 microversion: 2.1 time: 0.092818 Aug 24 06:54:38.873708 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 622/1215] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:38 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1268 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:39.894734 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:39.895333 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:39.902619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:39.903103 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:39.903529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:39.904225 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:39.904672 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:39.905091 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:40.310336 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:40.318222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2d9c34f7-0b84-47c9-a33a-318247dd64c4 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.427315 Aug 24 06:54:40.319017 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 594/1216] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:39 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:41.010575 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-160d85ff-9291-485e-8bf7-a2be8ebf6665 req-d3edfb87-d0c3-4dd2-a59e-ab8d4e2cdc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eff5cf4-bf78-4a56-9cb7-d100c828c158", "tag": "e9c24b9e-7353-417b-8f2a-1a3acbbe9bac"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:54:41.023002 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-160d85ff-9291-485e-8bf7-a2be8ebf6665 req-d3edfb87-d0c3-4dd2-a59e-ab8d4e2cdc49 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:41.023697 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-160d85ff-9291-485e-8bf7-a2be8ebf6665 req-d3edfb87-d0c3-4dd2-a59e-ab8d4e2cdc49 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:41.024100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-160d85ff-9291-485e-8bf7-a2be8ebf6665 req-d3edfb87-d0c3-4dd2-a59e-ab8d4e2cdc49 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:41.035843 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-160d85ff-9291-485e-8bf7-a2be8ebf6665 req-d3edfb87-d0c3-4dd2-a59e-ab8d4e2cdc49 service nova] Creating event network-changed:e9c24b9e-7353-417b-8f2a-1a3acbbe9bac for instance 8eff5cf4-bf78-4a56-9cb7-d100c828c158 on hv-cinder-85427 Aug 24 06:54:41.041069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-160d85ff-9291-485e-8bf7-a2be8ebf6665 req-d3edfb87-d0c3-4dd2-a59e-ab8d4e2cdc49 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037470 Aug 24 06:54:41.041800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 623/1217] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:41.339794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:41.341113 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:41.349130 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:41.349716 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:41.350288 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:41.351060 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:41.351444 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:41.351879 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:41.572224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:41.579993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6711756e-2e63-4f3e-8ff4-016f92d9b08c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.244779 Aug 24 06:54:41.580561 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 595/1218] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:41 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:42.602112 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:42.602793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:42.609014 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:42.609518 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:42.609940 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:42.610616 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:42.611054 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:42.611463 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:42.744604 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:42.752286 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0e188223-7f91-4bc4-a470-160055539403 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.154984 Aug 24 06:54:42.752843 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 624/1219] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:42 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:43.774736 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:43.775317 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:43.781261 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:43.781737 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:43.782164 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:43.782840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:43.783282 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:43.783696 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:43.918137 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:43.925864 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-165a36ef-4bf7-407e-8778-9a779debb05c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.155243 Aug 24 06:54:43.926421 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 596/1220] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:43 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:44.948120 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:44.948713 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:44.955068 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:44.955546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:44.955976 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:44.956659 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:44.957101 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:44.957556 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:45.087257 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:45.094882 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-edac28dc-78cc-42b1-9271-2b54516de5aa tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.151632 Aug 24 06:54:45.095458 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 625/1221] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:44 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:46.115042 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:46.115857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:46.122254 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:46.122731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:46.123169 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:46.123853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:46.124302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:46.124759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:46.255547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:46.263599 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2779694b-bf7a-4a31-a31f-9b6f5fce3ad1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.152501 Aug 24 06:54:46.264158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 597/1222] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:46 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:47.284445 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:47.285042 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:47.288106 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:47.292886 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:47.293396 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:47.293827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:47.294506 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:47.294947 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:47.295358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:47.430388 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:47.437998 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1b995742-cb26-4c46-a977-fe69288e81a1 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.157485 Aug 24 06:54:47.438570 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 626/1223] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:47 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:48.458837 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:48.459553 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:48.461542 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:48.462221 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=6 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:48.467302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:48.467773 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:48.468204 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:48.468877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:48.469347 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:48.469761 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:48.604665 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:48.612236 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-095009d5-b457-42c2-b073-d6020756a664 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.157342 Aug 24 06:54:48.612792 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 598/1224] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:48 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:49.632387 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:49.633116 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:49.639650 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:49.640129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:49.640558 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:49.641284 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:49.641726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:49.642146 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:49.789070 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:49.796739 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a2694ed1-3dae-4ef7-91a2-deee26991d39 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.168449 Aug 24 06:54:49.797314 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 627/1225] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:49 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:50.817624 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:50.818398 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:50.824896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:50.825686 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:50.826329 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:50.826690 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:50.827143 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:50.827568 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:50.960375 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:50.968230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5972f4be-e6ce-4c17-9006-7923d2bbd7c2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.154600 Aug 24 06:54:50.968791 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 599/1226] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:50 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:51.759710 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-e28a314c-9a4c-493e-b1bf-089ca1a88fc0 req-a7528f18-4f15-4e44-95a5-4af4fff924d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eff5cf4-bf78-4a56-9cb7-d100c828c158", "name": "network-vif-plugged", "status": "completed", "tag": "e9c24b9e-7353-417b-8f2a-1a3acbbe9bac"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:54:51.773260 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-e28a314c-9a4c-493e-b1bf-089ca1a88fc0 req-a7528f18-4f15-4e44-95a5-4af4fff924d9 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:51.773762 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-e28a314c-9a4c-493e-b1bf-089ca1a88fc0 req-a7528f18-4f15-4e44-95a5-4af4fff924d9 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:51.774186 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-e28a314c-9a4c-493e-b1bf-089ca1a88fc0 req-a7528f18-4f15-4e44-95a5-4af4fff924d9 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:51.786729 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-e28a314c-9a4c-493e-b1bf-089ca1a88fc0 req-a7528f18-4f15-4e44-95a5-4af4fff924d9 service nova] Creating event network-vif-plugged:e9c24b9e-7353-417b-8f2a-1a3acbbe9bac for instance 8eff5cf4-bf78-4a56-9cb7-d100c828c158 on hv-cinder-85427 Aug 24 06:54:51.792093 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-e28a314c-9a4c-493e-b1bf-089ca1a88fc0 req-a7528f18-4f15-4e44-95a5-4af4fff924d9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036772 Aug 24 06:54:51.799176 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 628/1227] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:51.989052 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:51.989826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:51.997586 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:51.998170 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:52.003477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:52.003477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:52.003477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:52.003477 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:52.191794 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:52.202639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2b4a589e-e194-4d2c-ab09-1819e6b11beb tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.217442 Aug 24 06:54:52.203260 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 600/1228] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:51 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:53.226544 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:53.227326 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:53.233524 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:53.234085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:53.234589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:53.235361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:53.235874 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:53.236363 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:53.385398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:53.393600 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-01e51ebd-b8a0-415e-960d-d766ae8e5a05 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1316 microversion: 2.1 time: 0.172607 Aug 24 06:54:53.394398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 629/1229] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:53 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:54.415251 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:54.415991 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:54.422533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:54.423013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:54.423439 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:54.424131 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:54.424577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:54.424994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:54.560406 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:54.568166 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1eaa8149-bc42-4dbc-a368-98f83bc58209 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1505 microversion: 2.1 time: 0.157097 Aug 24 06:54:54.569174 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 601/1230] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:54 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:17.460484 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c262f4a0-b1df-4a19-b1d6-535565306d1a tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7215d655-c255-46e1-82c0-96f001943a99", "device": "/dev/sdb"}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:55:17.463324 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c262f4a0-b1df-4a19-b1d6-535565306d1a tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:17.465426 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=20 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:17.466076 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=40 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:17.470635 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c262f4a0-b1df-4a19-b1d6-535565306d1a tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:17.477389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c262f4a0-b1df-4a19-b1d6-535565306d1a tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:17.477389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c262f4a0-b1df-4a19-b1d6-535565306d1a tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:17.477389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c262f4a0-b1df-4a19-b1d6-535565306d1a tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:17.477389 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c262f4a0-b1df-4a19-b1d6-535565306d1a tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:17.477795 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c262f4a0-b1df-4a19-b1d6-535565306d1a tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:18.285213 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c262f4a0-b1df-4a19-b1d6-535565306d1a tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "POST /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.828954 Aug 24 06:55:18.286004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 630/1231] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:55:17 2022] POST /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:46.182703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:46.183246 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:46.186011 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:46.186929 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=62 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:46.191961 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:46.192450 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:46.192888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:46.193616 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:46.194071 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:46.194498 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:46.502695 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lazy-loading 'services' on Instance uuid 8eff5cf4-bf78-4a56-9cb7-d100c828c158 {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:55:46.737838 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-740829e9-fdae-4d5c-bdd1-17937a8ed11d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158/os-volume_attachments/7215d655-c255-46e1-82c0-96f001943a99" status: 202 len: 0 microversion: 2.1 time: 0.559285 Aug 24 06:55:46.738349 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 602/1232] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:55:46 2022] DELETE /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158/os-volume_attachments/7215d655-c255-46e1-82c0-96f001943a99 => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:55:47.871476 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:47.872515 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:47.874785 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:47.875441 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:47.880390 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:47.880866 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:47.881327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:47.882015 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:47.882459 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:47.882874 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:47.910459 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Going to try to terminate instance {{(pid=127727) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:55:48.286532 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-060257c4-2c08-47a4-a859-fb703e9b6440 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 204 len: 0 microversion: 2.1 time: 0.419024 Aug 24 06:55:48.287310 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 631/1233] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:55:47 2022] DELETE /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:55:48.297459 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:48.298155 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:48.304351 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:48.304833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:48.305309 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:48.305990 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:48.306437 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:48.306856 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:48.442719 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:48.451004 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7601a66a-ad72-400d-8a68-33223c95ab6d tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1511 microversion: 2.1 time: 0.158992 Aug 24 06:55:48.451588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 603/1234] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:48 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:49.473014 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:49.473725 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:49.480126 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:49.480597 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:49.481021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:49.481735 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:49.482175 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:49.483100 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:49.729925 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:49.738085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-45005d51-604e-43b1-b92c-41474589decf tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1511 microversion: 2.1 time: 0.269367 Aug 24 06:55:49.738647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 632/1235] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:49 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:50.706565 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-315004b4-70de-4dd1-92e6-d0b78ed42a8a req-5854cc06-567f-4d51-b898-62a96132a69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eff5cf4-bf78-4a56-9cb7-d100c828c158", "name": "network-vif-deleted", "tag": "e9c24b9e-7353-417b-8f2a-1a3acbbe9bac"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:55:50.716688 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-315004b4-70de-4dd1-92e6-d0b78ed42a8a req-5854cc06-567f-4d51-b898-62a96132a69f service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:50.717157 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-315004b4-70de-4dd1-92e6-d0b78ed42a8a req-5854cc06-567f-4d51-b898-62a96132a69f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:50.717597 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-315004b4-70de-4dd1-92e6-d0b78ed42a8a req-5854cc06-567f-4d51-b898-62a96132a69f service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:50.728509 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-315004b4-70de-4dd1-92e6-d0b78ed42a8a req-5854cc06-567f-4d51-b898-62a96132a69f service nova] Creating event network-vif-deleted:e9c24b9e-7353-417b-8f2a-1a3acbbe9bac for instance 8eff5cf4-bf78-4a56-9cb7-d100c828c158 on hv-cinder-85427 Aug 24 06:55:50.733466 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-315004b4-70de-4dd1-92e6-d0b78ed42a8a req-5854cc06-567f-4d51-b898-62a96132a69f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030679 Aug 24 06:55:50.736144 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 604/1236] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:50.759915 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:50.760510 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:50.767908 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:50.770674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:50.770674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:50.770674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:50.770674 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:50.771080 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:50.840189 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:50.848423 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6a1243e1-d903-41fe-88f2-a1d9481530d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 200 len: 1469 microversion: 2.1 time: 0.092305 Aug 24 06:55:50.849024 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 633/1237] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:50 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 1469 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:51.573801 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:55:51.574034 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Wed Aug 24 06:55:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:55:51.871316 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:51.872005 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 8eff5cf4-bf78-4a56-9cb7-d100c828c158] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:51.879591 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:51.880241 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:51.880877 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:51.881513 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:51.881849 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:51.882263 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:51.895731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] HTTP exception thrown: Instance 8eff5cf4-bf78-4a56-9cb7-d100c828c158 could not be found. Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Request method failure captured: Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 HTTP/1.1 Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcsoTtvo1z88lYLfOscDohp0iMhKQHpFIpt_3zwD74CCE0r5m1CHNIQzuhurZDLKIVJS6iCGpoQIEsRB589mhiy8EpijkANre-gK_ZAk6LQdBGbrHlwL_r3CvLu0mov4zOiL8Ycb-K_BodKRVTDe62RkDfyrUUzP6fU3Xk7jBq_QMzs Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: e443552ae9eb446a94665b5674b57f15 Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1362677178 Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:55:51.897388 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e443552ae9eb446a94665b5674b57f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e443552ae9eb446a94665b5674b57f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e443552ae9eb446a94665b5674b57f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e443552ae9eb446a94665b5674b57f15", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesSnapshotTestJSON-1362677178 Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: e443552ae9eb446a94665b5674b57f15 Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1362677178 Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesSnapshotTestJSON-1362677178-project Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 8bc75750fe3348c18cde49a64456f879 Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesSnapshotTestJSON-1362677178-project Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 8eff5cf4-bf78-4a56-9cb7-d100c828c158 could not be found. Aug 24 06:55:51.899302 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '8eff5cf4-bf78-4a56-9cb7-d100c828c158'} Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eff5cf4-bf78-4a56-9cb7-d100c828c158 could not be found. Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:55:51.900363 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eff5cf4-bf78-4a56-9cb7-d100c828c158 could not be found. Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eff5cf4-bf78-4a56-9cb7-d100c828c158 could not be found. Aug 24 06:55:51.902068 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:55:51.903649 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Returning 404 to user: Instance 8eff5cf4-bf78-4a56-9cb7-d100c828c158 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:55:51.903649 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d6df40e5-dada-4185-a72d-9e64808190d2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158" status: 404 len: 111 microversion: 2.1 time: 0.032344 Aug 24 06:55:51.903649 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 605/1238] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:51 2022] GET /compute/v2.1/servers/8eff5cf4-bf78-4a56-9cb7-d100c828c158 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:55:56.878035 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:55:56.878637 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Wed Aug 24 06:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:56:03.605957 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-848116326", "imageRef": "9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5", "flavorRef": "452", "networks": [{"uuid": "2f7f46d8-77e7-438e-a474-5c38bb877f48"}]}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:03.615685 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:03.616336 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:03.664722 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.network.neutron [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] validate_networks() for [('2f7f46d8-77e7-438e-a474-5c38bb877f48', None, None, None, None, None)] {{(pid=127727) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:56:04.019192 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Flavor limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:56:04.019605 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Image limits 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:56:04.020069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Flavor pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:56:04.020502 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Image pref 0:0:0 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:56:04.020905 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.virt.hardware [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:56:04.033806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:04.033806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:04.033806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:04.033806 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:04.034338 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:04.034338 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:04.049857 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Getting quotas for project e443552ae9eb446a94665b5674b57f15. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:56:04.054127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.quota [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Getting quotas for user 8bc75750fe3348c18cde49a64456f879 and project e443552ae9eb446a94665b5674b57f15. Resources: {'cores', 'instances', 'ram'} {{(pid=127727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:56:04.065922 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Going to run 1 instances... {{(pid=127727) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:56:04.068248 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcb6d92-2476-4901-82cc-ef0cfc7bc7d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:56:04.230132 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ca746dde-eb3e-405b-b589-911c755c7e44 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627746 Aug 24 06:56:04.230779 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 634/1239] 10.222.0.47 () {60 vars in 1147 bytes} [Wed Aug 24 06:56:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:56:04.241946 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2998b686-2d36-422c-a3f3-9bb57ed84468 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:04.242559 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2998b686-2d36-422c-a3f3-9bb57ed84468 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:04.245028 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=8 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:04.245833 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:04.302468 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2998b686-2d36-422c-a3f3-9bb57ed84468 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:04.311390 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2998b686-2d36-422c-a3f3-9bb57ed84468 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1218 microversion: 2.1 time: 0.073403 Aug 24 06:56:04.311957 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 606/1240] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:04 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:05.335195 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:05.335837 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:05.344006 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:05.344495 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:05.344931 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:05.345670 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:05.346131 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:05.346546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:05.415805 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:05.424366 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3c3e89f8-dc3e-4d3d-8cc9-921d5561ae70 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1222 microversion: 2.1 time: 0.093894 Aug 24 06:56:05.425123 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 635/1241] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:05 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:06.447028 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:06.447636 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:06.455431 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:06.456997 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:06.456997 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:06.457288 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:06.457908 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:06.458496 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:06.523102 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:06.530993 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-017533a6-a3e2-49e5-93e5-9c349b133a40 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1288 microversion: 2.1 time: 0.088736 Aug 24 06:56:06.531554 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 607/1242] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:06 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:07.551647 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:07.552263 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:07.558973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:07.563394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:07.563394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:07.563394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:07.563394 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:07.565126 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:07.704358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:07.712645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-3fe7dbd2-0d17-46f3-be44-bfdfa3a88243 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1318 microversion: 2.1 time: 0.164935 Aug 24 06:56:07.713449 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 636/1243] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:07 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:56:07.820193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-0ce8b5b6-2a60-4101-b34d-14c3c20e1666 req-2990cb69-82af-4378-a3a4-a86332b03b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "288638ee-b436-42c0-ac89-2dbe6400d059", "tag": "78170ccd-29a1-4739-8022-30a1acee50b6"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:07.836942 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-0ce8b5b6-2a60-4101-b34d-14c3c20e1666 req-2990cb69-82af-4378-a3a4-a86332b03b66 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:07.837455 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-0ce8b5b6-2a60-4101-b34d-14c3c20e1666 req-2990cb69-82af-4378-a3a4-a86332b03b66 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:07.837883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-0ce8b5b6-2a60-4101-b34d-14c3c20e1666 req-2990cb69-82af-4378-a3a4-a86332b03b66 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:07.849001 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-0ce8b5b6-2a60-4101-b34d-14c3c20e1666 req-2990cb69-82af-4378-a3a4-a86332b03b66 service nova] Creating event network-changed:78170ccd-29a1-4739-8022-30a1acee50b6 for instance 288638ee-b436-42c0-ac89-2dbe6400d059 on hv-cinder-85427 Aug 24 06:56:07.854120 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-0ce8b5b6-2a60-4101-b34d-14c3c20e1666 req-2990cb69-82af-4378-a3a4-a86332b03b66 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037479 Aug 24 06:56:07.854552 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 608/1244] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:56:08.735148 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:08.735790 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:08.742155 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:08.742643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:08.743077 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:08.743771 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:08.744224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:08.744666 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:08.877654 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:08.884965 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-81838f40-845b-4ce4-8ebf-e38440286a79 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1318 microversion: 2.1 time: 0.154682 Aug 24 06:56:08.885554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 637/1245] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:08 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:09.907075 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:09.907716 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:09.914019 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:09.914525 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:09.914959 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:09.915674 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:09.916124 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:09.916599 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:10.048775 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:10.056558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-eddeeb56-c4eb-4ea8-903a-30e940bd6fbc tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1318 microversion: 2.1 time: 0.154347 Aug 24 06:56:10.057124 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 609/1246] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:09 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:11.078642 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:11.079194 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:11.085883 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:11.086358 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:11.086785 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:11.087466 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:11.087916 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:11.088327 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:11.448899 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:11.457046 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-319d5da1-01fb-450d-ac5b-65c6e9201222 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1318 microversion: 2.1 time: 0.383029 Aug 24 06:56:11.457654 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 638/1247] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:11 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:12.476504 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:12.477108 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:12.484076 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:12.484548 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:12.484983 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:12.485811 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:12.486268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:12.487396 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:12.629899 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:12.637759 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-772b3eaf-b738-41cf-8c50-ac2fe740ca86 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1318 microversion: 2.1 time: 0.165090 Aug 24 06:56:12.644029 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 610/1248] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:12 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:13.660631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:13.661258 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:13.667552 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:13.668019 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:13.668443 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:13.669113 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:13.669589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:13.670133 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:13.798990 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:13.806514 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-96fd8938-ad3e-4c69-91f4-568f7c421992 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1318 microversion: 2.1 time: 0.149668 Aug 24 06:56:13.807069 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 639/1249] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:13 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:14.136378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-d9c6ffb4-f08a-4092-a74f-52e4356af2a2 req-1b4f6c48-8e68-4b14-868f-bfd9620787a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288638ee-b436-42c0-ac89-2dbe6400d059", "name": "network-vif-plugged", "status": "completed", "tag": "78170ccd-29a1-4739-8022-30a1acee50b6"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:14.146777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-d9c6ffb4-f08a-4092-a74f-52e4356af2a2 req-1b4f6c48-8e68-4b14-868f-bfd9620787a0 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:14.147253 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-d9c6ffb4-f08a-4092-a74f-52e4356af2a2 req-1b4f6c48-8e68-4b14-868f-bfd9620787a0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:14.147686 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-d9c6ffb4-f08a-4092-a74f-52e4356af2a2 req-1b4f6c48-8e68-4b14-868f-bfd9620787a0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:14.158985 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-d9c6ffb4-f08a-4092-a74f-52e4356af2a2 req-1b4f6c48-8e68-4b14-868f-bfd9620787a0 service nova] Creating event network-vif-plugged:78170ccd-29a1-4739-8022-30a1acee50b6 for instance 288638ee-b436-42c0-ac89-2dbe6400d059 on hv-cinder-85427 Aug 24 06:56:14.164136 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-d9c6ffb4-f08a-4092-a74f-52e4356af2a2 req-1b4f6c48-8e68-4b14-868f-bfd9620787a0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031395 Aug 24 06:56:14.164719 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 611/1250] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:56:14.830800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:14.830800 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:14.832078 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=2 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:14.832737 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell0:SELECT=6 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:14.838123 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:14.838611 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:14.839043 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:14.839741 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:14.840186 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:14.840633 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:14.978448 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:14.986817 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c2f0118b-ade6-4f19-bea6-ba0b604435a2 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1318 microversion: 2.1 time: 0.161634 Aug 24 06:56:14.987373 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 640/1251] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:14 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:16.004608 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell0:SELECT=2 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:16.009264 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:16.009953 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:16.016139 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:16.016612 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:16.019061 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:16.019061 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:16.019061 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:16.019061 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:16.156679 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:16.165061 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-219f2676-31de-41e7-958a-87b969fda538 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1318 microversion: 2.1 time: 0.161145 Aug 24 06:56:16.165619 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 612/1252] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:16 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:17.185417 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:17.186021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:17.193888 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:17.194625 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:17.194801 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:17.195486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:17.195964 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:17.196382 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:17.324840 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:17.333518 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-6e6b677d-19d3-4081-9d1b-e1b640b8eeae tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1507 microversion: 2.1 time: 0.151994 Aug 24 06:56:17.334085 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 641/1253] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:17 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:17.354171 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fda95221-d348-42f9-ba18-7c2d73d5e6ec tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e56d4d8d-b540-4311-a4b9-19f3d247cec2", "device": "/dev/sdb"}} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:17.356998 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fda95221-d348-42f9-ba18-7c2d73d5e6ec tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:17.363636 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fda95221-d348-42f9-ba18-7c2d73d5e6ec tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:17.364504 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fda95221-d348-42f9-ba18-7c2d73d5e6ec tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:17.364625 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fda95221-d348-42f9-ba18-7c2d73d5e6ec tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:17.365222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fda95221-d348-42f9-ba18-7c2d73d5e6ec tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:17.365674 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fda95221-d348-42f9-ba18-7c2d73d5e6ec tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:17.366092 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fda95221-d348-42f9-ba18-7c2d73d5e6ec tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:18.054358 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fda95221-d348-42f9-ba18-7c2d73d5e6ec tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "POST /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703865 Aug 24 06:56:18.054975 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 613/1254] 10.222.0.47 () {60 vars in 1323 bytes} [Wed Aug 24 06:56:17 2022] POST /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:56:30.885853 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:30.886473 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:30.888900 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:30.889939 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=44 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:30.894920 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:30.895398 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:30.895874 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:30.896557 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:30.897000 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:30.897443 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:30.920273 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lazy-loading 'flavor' on Instance uuid d9f3238d-9433-4c26-b0f3-6b3699264721 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:56:31.278409 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-412f7f5b-07ee-40fa-85df-ae4fccb2bee8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "POST /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721/action" status: 202 len: 0 microversion: 2.1 time: 0.396560 Aug 24 06:56:31.278985 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 642/1255] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:56:30 2022] POST /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:56:31.286172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=18 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:31.286960 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:31.291074 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:31.291868 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:31.298679 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:31.299166 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:31.299603 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:31.300324 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:31.300779 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:31.301222 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:31.438818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:31.446680 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c4761840-c4be-4547-90aa-3891bcbff23f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.162094 Aug 24 06:56:31.447237 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 614/1256] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:31 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:32.470392 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:32.471141 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:32.478053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:32.478546 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:32.478982 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:32.479705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:32.480158 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:32.480585 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:32.619424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:32.628564 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-c4c43baf-5b81-4877-8afb-d1045b108525 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.163223 Aug 24 06:56:32.629144 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 643/1257] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:32 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:33.651084 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:33.651699 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:33.658549 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:33.659644 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:33.660091 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:33.660804 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:33.661285 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:33.661708 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:33.797095 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:33.805067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-699fb975-149a-4327-9594-a2b93f6e98b2 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.158201 Aug 24 06:56:33.805663 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 615/1258] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:33 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:34.826256 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:34.826864 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:34.834357 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:34.834831 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:34.835256 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:34.835938 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:34.836386 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:34.836796 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:34.973153 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:34.981444 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1555af05-c846-4c2b-be6f-61cf9a0b6dcb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.159063 Aug 24 06:56:34.982004 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 644/1259] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:34 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:36.003094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:36.003645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:36.010094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:36.010578 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:36.011013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:36.011703 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:36.012156 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:36.012577 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:36.144320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:36.152321 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-5d0370a7-56bb-4bd8-a624-e1eff6883ab0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.153426 Aug 24 06:56:36.152887 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 616/1260] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:35 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:56:37.173917 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:37.174480 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:37.180620 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:37.181101 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:37.197152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:37.197152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:37.197152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:37.197152 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:37.316147 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:37.324124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-5291ef32-5917-4fc4-befd-1dfb08b782f8 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.154780 Aug 24 06:56:37.324755 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 645/1261] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:37 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:38.347175 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:38.347714 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:38.354119 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:38.354592 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:38.355016 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:38.355698 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:38.356139 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:38.356551 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:38.497365 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:38.506044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7194b380-e37e-4b23-92d4-c67179a000df tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.163879 Aug 24 06:56:38.506615 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 617/1262] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:38 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:39.527429 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:39.528083 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:39.534599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:39.535075 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:39.535509 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:39.536196 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:39.536645 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:39.537065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:39.678151 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:39.685986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0cf63146-d7ac-47ad-ad8d-81368454b683 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.162594 Aug 24 06:56:39.686542 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 646/1263] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:39 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:40.287840 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:40.288326 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:40.295014 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:40.295488 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:40.295925 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:40.297536 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:40.298217 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:40.298556 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:40.391596 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.objects.instance [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lazy-loading 'services' on Instance uuid 288638ee-b436-42c0-ac89-2dbe6400d059 {{(pid=127728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:56:40.618640 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-1e8b64c1-88aa-4fac-929c-7e275d3808f8 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "DELETE /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059/os-volume_attachments/e56d4d8d-b540-4311-a4b9-19f3d247cec2" status: 202 len: 0 microversion: 2.1 time: 0.334470 Aug 24 06:56:40.619237 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 618/1264] 10.222.0.47 () {58 vars in 1416 bytes} [Wed Aug 24 06:56:40 2022] DELETE /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059/os-volume_attachments/e56d4d8d-b540-4311-a4b9-19f3d247cec2 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:56:40.712012 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:40.713105 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:40.720224 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:40.720707 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:40.721137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:40.721869 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:40.722318 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:40.722738 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:40.861949 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:40.869789 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-1317d53c-b92f-49df-ac1b-a38bb6023fb3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.165289 Aug 24 06:56:40.870361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 647/1265] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:40 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:41.749816 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:41.750529 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:41.758135 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:41.759067 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:41.759273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:41.760145 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:41.760660 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:41.761115 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:41.788077 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:56:41.892859 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:41.893752 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:41.900225 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:41.900705 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:41.901142 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:41.901864 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:41.902316 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:41.902761 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:42.056241 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:42.065830 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-dce3e0b2-7847-4404-b414-b9f133feeac0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.177647 Aug 24 06:56:42.066421 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 648/1266] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:41 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:56:42.193755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-676ac3f5-814d-4eab-99e8-d66048f7ca53 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "DELETE /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 204 len: 0 microversion: 2.1 time: 0.449425 Aug 24 06:56:42.194258 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 619/1267] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:56:41 2022] DELETE /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:56:42.202486 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:42.203867 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:42.210212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:42.211186 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:42.211186 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:42.211785 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:42.212233 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:42.212663 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:42.348907 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:42.356631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-11f1f9ba-1af2-4b8d-8da0-d46c5cecf61f tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1513 microversion: 2.1 time: 0.158008 Aug 24 06:56:42.357212 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 649/1268] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:42 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:43.088472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:43.089165 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:43.096717 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:43.097203 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:43.097653 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:43.098338 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:43.098787 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:43.099206 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:43.241894 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:43.249920 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9d2a6e3a-9b55-4d82-a3a5-b30dee47ee1f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.165606 Aug 24 06:56:43.250480 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 620/1269] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:43 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:43.378196 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:43.378924 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:43.385315 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:43.385801 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:43.386262 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:43.386954 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:43.387407 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:43.387850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:43.524252 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:43.533162 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-d630937b-daac-4c79-a56c-fb3512644947 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1513 microversion: 2.1 time: 0.158894 Aug 24 06:56:43.533746 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 650/1270] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:43 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:44.272046 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:44.272680 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:44.279646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:44.280122 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:44.280557 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:44.281273 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:44.281727 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:44.282143 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:44.418633 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:44.427425 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-9490ddee-2f53-48fc-8cbf-a2ace0146dbc tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.159709 Aug 24 06:56:44.428191 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 621/1271] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:44 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:44.514040 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-1700d78c-5fc4-4d05-8c14-4d2d7a842965 req-a5a49a80-d5a7-485d-9957-2440098cf573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288638ee-b436-42c0-ac89-2dbe6400d059", "name": "network-vif-deleted", "tag": "78170ccd-29a1-4739-8022-30a1acee50b6"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:44.524704 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-1700d78c-5fc4-4d05-8c14-4d2d7a842965 req-a5a49a80-d5a7-485d-9957-2440098cf573 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:44.525223 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-1700d78c-5fc4-4d05-8c14-4d2d7a842965 req-a5a49a80-d5a7-485d-9957-2440098cf573 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:44.525661 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-1700d78c-5fc4-4d05-8c14-4d2d7a842965 req-a5a49a80-d5a7-485d-9957-2440098cf573 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:44.537280 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-1700d78c-5fc4-4d05-8c14-4d2d7a842965 req-a5a49a80-d5a7-485d-9957-2440098cf573 service nova] Creating event network-vif-deleted:78170ccd-29a1-4739-8022-30a1acee50b6 for instance 288638ee-b436-42c0-ac89-2dbe6400d059 on hv-cinder-85427 Aug 24 06:56:44.542344 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-1700d78c-5fc4-4d05-8c14-4d2d7a842965 req-a5a49a80-d5a7-485d-9957-2440098cf573 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032668 Aug 24 06:56:44.542937 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 651/1272] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:56:44.553580 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:44.554189 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:44.560171 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:44.560654 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:44.561090 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:44.561863 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:44.562320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:44.562738 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:44.629124 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc75750fe3348c18cde49a64456f879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e443552ae9eb446a94665b5674b57f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:44.636835 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-581c624a-8791-4bb3-9c28-4266a029520c tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 200 len: 1471 microversion: 2.1 time: 0.087126 Aug 24 06:56:44.637433 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 622/1273] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:44 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:45.457065 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:45.457793 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:45.463973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:45.464376 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:45.464830 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:45.465550 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:45.465996 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:45.466418 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:45.613055 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:45.620962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-4b94a4cb-0f8f-477b-9aef-8d93cfaea370 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.168718 Aug 24 06:56:45.621574 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 652/1274] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:45 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:45.659910 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:45.660466 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] [instance: 288638ee-b436-42c0-ac89-2dbe6400d059] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:45.666585 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:45.667060 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:45.667489 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:45.668177 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:45.668616 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:45.669028 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:45.682214 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] HTTP exception thrown: Instance 288638ee-b436-42c0-ac89-2dbe6400d059 could not be found. Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Request method failure captured: Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 HTTP/1.1 Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcsoTtvo1z88lYLfOscDohp0iMhKQHpFIpt_3zwD74CCE0r5m1CHNIQzuhurZDLKIVJS6iCGpoQIEsRB589mhiy8EpijkANre-gK_ZAk6LQdBGbrHlwL_r3CvLu0mov4zOiL8Ycb-K_BodKRVTDe62RkDfyrUUzP6fU3Xk7jBq_QMzs Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: e443552ae9eb446a94665b5674b57f15 Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1362677178 Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:56:45.683836 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e443552ae9eb446a94665b5674b57f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e443552ae9eb446a94665b5674b57f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e443552ae9eb446a94665b5674b57f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e443552ae9eb446a94665b5674b57f15", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-VolumesSnapshotTestJSON-1362677178 Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: e443552ae9eb446a94665b5674b57f15 Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1362677178 Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-VolumesSnapshotTestJSON-1362677178-project Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 8bc75750fe3348c18cde49a64456f879 Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-VolumesSnapshotTestJSON-1362677178-project Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance 288638ee-b436-42c0-ac89-2dbe6400d059 could not be found. Aug 24 06:56:45.690196 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': '288638ee-b436-42c0-ac89-2dbe6400d059'} Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288638ee-b436-42c0-ac89-2dbe6400d059 could not be found. Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:56:45.691245 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288638ee-b436-42c0-ac89-2dbe6400d059 could not be found. Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288638ee-b436-42c0-ac89-2dbe6400d059 could not be found. Aug 24 06:56:45.693366 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:56:45.695013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] Returning 404 to user: Instance 288638ee-b436-42c0-ac89-2dbe6400d059 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:56:45.695013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c601481e-ee73-4710-b6da-4ae503f18653 tempest-VolumesSnapshotTestJSON-1362677178 tempest-VolumesSnapshotTestJSON-1362677178-project] 10.222.0.47 "GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059" status: 404 len: 111 microversion: 2.1 time: 0.030784 Aug 24 06:56:45.695013 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 623/1275] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:45 2022] GET /compute/v2.1/servers/288638ee-b436-42c0-ac89-2dbe6400d059 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:56:46.646207 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:46.646900 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:46.653315 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:46.653791 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:46.654218 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:46.654971 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:46.655413 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:46.655827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:46.795286 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:46.803369 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-fff67f7b-76aa-4908-9522-50d8e2cab1d7 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.161101 Aug 24 06:56:46.803933 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 653/1276] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:46 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:47.825357 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:47.827453 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:47.833743 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:47.834214 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:47.834641 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:47.835330 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:47.835780 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:47.836193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:47.972218 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:47.980220 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-7ce19c74-8176-4d87-b1b5-7296fc8ab22f tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.158871 Aug 24 06:56:47.980777 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 624/1277] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:47 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:49.002952 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:49.003512 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:49.009927 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:49.010404 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:49.010835 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:49.011517 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:49.011963 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:49.012378 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:49.147255 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:49.155053 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-57fb7bde-9853-4271-989e-c0536f9cfcc4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.157062 Aug 24 06:56:49.155628 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 654/1278] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:48 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:50.176262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:50.176876 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:50.183598 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:50.184081 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:50.184588 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:50.185324 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:50.185779 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:50.186202 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:50.318640 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:50.326299 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-2d46541e-570a-4413-8c81-9d6dd43746e5 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.154210 Aug 24 06:56:50.326861 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 625/1279] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:50 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:51.348384 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:51.348946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:51.355361 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:51.355850 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:51.356304 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:51.356978 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:51.357453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:51.357878 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:51.490662 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:51.498424 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-f7859a6d-8f40-44c9-96ad-a31a4d226aaa tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.153990 Aug 24 06:56:51.498986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 655/1280] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:51 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:52.236213 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-90c89233-ab9d-4980-b952-cc39f1cc4e42 req-438fcaf1-13a9-4eab-93a6-5ddd3f5aafa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f3238d-9433-4c26-b0f3-6b3699264721", "name": "network-vif-unplugged", "status": "completed", "tag": "3cbe7c52-b66d-42ce-a944-01967a8d9f64"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:52.246574 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-90c89233-ab9d-4980-b952-cc39f1cc4e42 req-438fcaf1-13a9-4eab-93a6-5ddd3f5aafa0 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:52.247044 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-90c89233-ab9d-4980-b952-cc39f1cc4e42 req-438fcaf1-13a9-4eab-93a6-5ddd3f5aafa0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:52.247463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-90c89233-ab9d-4980-b952-cc39f1cc4e42 req-438fcaf1-13a9-4eab-93a6-5ddd3f5aafa0 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:52.258424 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-90c89233-ab9d-4980-b952-cc39f1cc4e42 req-438fcaf1-13a9-4eab-93a6-5ddd3f5aafa0 service nova] Creating event network-vif-unplugged:3cbe7c52-b66d-42ce-a944-01967a8d9f64 for instance d9f3238d-9433-4c26-b0f3-6b3699264721 on hv-cinder-85427 Aug 24 06:56:52.263311 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-90c89233-ab9d-4980-b952-cc39f1cc4e42 req-438fcaf1-13a9-4eab-93a6-5ddd3f5aafa0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031563 Aug 24 06:56:52.263894 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 626/1281] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:56:52.520150 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:52.520686 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:52.527554 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:52.528029 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:52.528451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:52.529170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:52.529638 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:52.530081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:52.670909 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:52.678934 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-8c4abecd-bc5b-4088-ab5a-d71c184f08eb tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.163426 Aug 24 06:56:52.679623 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 656/1282] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:52 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:56:53.702757 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:53.703460 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:53.710279 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:53.710755 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:53.711184 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:53.711863 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:53.712295 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:53.712711 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:53.855589 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:53.864062 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-d35b2a9f-df67-4297-9dcf-45949db99aed tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1507 microversion: 2.1 time: 0.165897 Aug 24 06:56:53.864817 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 627/1283] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:53 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:53.889547 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:53.890129 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:53.898104 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:53.898587 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:53.899023 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:53.899717 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:53.900170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:53.900589 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:53.904603 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:53.929903 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127727) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 06:56:54.289631 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-a5a5cae2-30b7-4519-b2c9-62316a256383 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "POST /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721/action" status: 202 len: 0 microversion: 2.1 time: 0.403928 Aug 24 06:56:54.290235 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 657/1284] 10.222.0.47 () {60 vars in 1278 bytes} [Wed Aug 24 06:56:53 2022] POST /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:56:54.298443 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:54.302974 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:54.306193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:54.306676 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:54.307110 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:54.307874 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:54.308320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:54.308740 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:54.443349 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:54.451355 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-3ed99cba-8acc-4ca1-8aab-db0447a837de tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1515 microversion: 2.1 time: 0.156854 Aug 24 06:56:54.451932 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 628/1285] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:54 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:55.474427 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:55.475031 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:55.481103 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:55.481619 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:55.482050 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:55.482771 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:55.483199 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:55.483617 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:55.623170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:55.631986 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-0f785d72-0101-4353-a342-53bb69ed5472 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1517 microversion: 2.1 time: 0.162813 Aug 24 06:56:55.632549 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 658/1286] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:55 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:56.654818 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:56.655461 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:56.662430 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:56.662897 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:56.663353 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:56.664037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:56.664472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:56.664883 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:56.684200 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:56.804331 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:56.811963 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-c0e98191-db21-409a-835d-edab9a151cba tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1517 microversion: 2.1 time: 0.161070 Aug 24 06:56:56.812713 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 629/1287] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:56 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:57.834890 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:57.835628 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:57.842200 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:57.842609 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:57.843041 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:57.843743 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:57.844197 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:57.844651 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:57.984909 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:57.993655 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-979b10e1-bca1-4f0e-8baa-5b882e602330 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.162622 Aug 24 06:56:57.994233 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 659/1288] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:57 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:59.015360 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:59.015973 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:59.022710 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:59.023184 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:59.023611 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:59.024292 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:59.024770 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:59.025201 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:59.157636 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:59.165444 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-6d031eab-cb9c-406e-aa78-ee8a6059920c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.154234 Aug 24 06:56:59.166012 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 630/1289] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:59 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:00.186360 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:00.186960 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:00.193606 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:00.194082 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:00.194518 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:00.195222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:00.195667 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:00.196084 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:00.331906 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:00.339914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-30c2c03b-426c-4270-8ae9-e0fa4e7c36c9 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.157405 Aug 24 06:57:00.340495 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 660/1290] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:00 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:01.361558 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:01.362230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:01.368645 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:01.369138 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:01.369607 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:01.370320 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:01.370768 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:01.371193 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:01.507847 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:01.515640 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-cbd6e90d-c153-431b-807a-45faae8c659c tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.158079 Aug 24 06:57:01.516210 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 631/1291] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:01 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:02.540165 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:02.540780 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:02.543262 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:02.547889 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:02.548390 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:02.548817 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:02.549533 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:02.549973 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:02.550385 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:02.682596 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:02.690272 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-cb21027b-f313-4c9b-9d94-65ee64e9d1e6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.156216 Aug 24 06:57:02.690827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 661/1292] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:02 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:03.712037 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:03.712962 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:03.714948 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:03.719752 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:03.720230 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:03.720663 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:03.721406 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:03.721855 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:03.722276 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:03.854439 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:03.862216 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-354e6272-ff41-40d0-8976-b3c9bca8db4a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.155233 Aug 24 06:57:03.862778 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 632/1293] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:03 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:57:04.884170 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:04.884816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:04.891573 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:04.894946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:04.894946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:04.894946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:04.894946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:04.895941 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:05.031203 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:05.040740 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-533590be-8a9b-4484-a0e3-f231e779d296 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.160929 Aug 24 06:57:05.041341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 662/1294] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:04 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:06.062630 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:06.063182 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:06.069942 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:06.070448 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:06.070876 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:06.071552 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:06.071995 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:06.072411 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:06.215460 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:06.228458 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-fac427b1-1bb6-4ac4-8bbc-94ffd869cbd3 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.170107 Aug 24 06:57:06.229238 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 633/1295] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:06 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:07.250836 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:07.251422 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:07.258222 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:07.261522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:07.261522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:07.261522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:07.261522 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:07.261995 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:07.391081 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:07.399198 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-38bcd459-dcb5-4c31-b067-b50534928f7e tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.152359 Aug 24 06:57:07.399763 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 663/1296] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:07 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:08.358783 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-86fe3148-7066-4bee-a27e-a24d0e1a604a req-f9f58261-d6b3-4dc9-8359-928d69f0592c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f3238d-9433-4c26-b0f3-6b3699264721", "name": "network-vif-plugged", "status": "completed", "tag": "3cbe7c52-b66d-42ce-a944-01967a8d9f64"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:57:08.364484 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-86fe3148-7066-4bee-a27e-a24d0e1a604a req-f9f58261-d6b3-4dc9-8359-928d69f0592c service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:08.365094 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-86fe3148-7066-4bee-a27e-a24d0e1a604a req-f9f58261-d6b3-4dc9-8359-928d69f0592c service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:08.365848 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-86fe3148-7066-4bee-a27e-a24d0e1a604a req-f9f58261-d6b3-4dc9-8359-928d69f0592c service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:08.377218 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-86fe3148-7066-4bee-a27e-a24d0e1a604a req-f9f58261-d6b3-4dc9-8359-928d69f0592c service nova] Creating event network-vif-plugged:3cbe7c52-b66d-42ce-a944-01967a8d9f64 for instance d9f3238d-9433-4c26-b0f3-6b3699264721 on hv-cinder-85427 Aug 24 06:57:08.383141 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-86fe3148-7066-4bee-a27e-a24d0e1a604a req-f9f58261-d6b3-4dc9-8359-928d69f0592c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031914 Aug 24 06:57:08.383725 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 634/1297] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:57:08.421207 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:08.421938 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:08.428623 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:08.429283 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:08.429726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:08.430482 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:08.430925 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:08.431341 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:08.572962 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:08.581079 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-ff21fa67-8b26-452d-953c-cae7df9206b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.164546 Aug 24 06:57:08.581701 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 664/1298] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:08 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:09.604103 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:09.604790 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:09.610989 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:09.611463 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:09.611896 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:09.612597 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:09.613038 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:09.613533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:09.746646 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:09.754547 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-816c7421-817b-4b67-9593-eac89f1b3475 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1573 microversion: 2.1 time: 0.156046 Aug 24 06:57:09.759088 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 635/1299] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:09 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:10.775863 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:10.776455 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:10.782932 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:10.783404 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:10.783827 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:10.784507 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:10.785021 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:10.785419 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:10.920525 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:10.928968 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-99c34d25-1f47-4197-a435-cec2de1b5df0 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1560 microversion: 2.1 time: 0.156597 Aug 24 06:57:10.929565 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 665/1300] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:10 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:30.054376 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:57:30.055055 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Wed Aug 24 06:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:58:40.930803 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_api:SELECT=9 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:40.941511 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:40.942541 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG dbcounter [-] [127727] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:40.942659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:40.942659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_api:SELECT=7 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:40.942659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG dbcounter [-] [127728] Writing DB stats nova_cell1:SELECT=34 {{(pid=127728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:40.942659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:40.942659 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:40.943152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:40.943152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:40.943152 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:40.943436 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:40.971922 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Going to try to terminate instance {{(pid=127728) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:58:41.070868 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [req-0ecfc4a2-4bad-490a-987f-46a8778dbb29 req-c7998fca-792e-46e4-81c4-7e34ab945f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f3238d-9433-4c26-b0f3-6b3699264721", "tag": "3cbe7c52-b66d-42ce-a944-01967a8d9f64"}]} {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:58:41.081145 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-0ecfc4a2-4bad-490a-987f-46a8778dbb29 req-c7998fca-792e-46e4-81c4-7e34ab945f34 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:41.084837 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-0ecfc4a2-4bad-490a-987f-46a8778dbb29 req-c7998fca-792e-46e4-81c4-7e34ab945f34 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:41.084837 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [req-0ecfc4a2-4bad-490a-987f-46a8778dbb29 req-c7998fca-792e-46e4-81c4-7e34ab945f34 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:41.094259 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.compute.server_external_events [req-0ecfc4a2-4bad-490a-987f-46a8778dbb29 req-c7998fca-792e-46e4-81c4-7e34ab945f34 service nova] Creating event network-changed:3cbe7c52-b66d-42ce-a944-01967a8d9f64 for instance d9f3238d-9433-4c26-b0f3-6b3699264721 on hv-cinder-85427 Aug 24 06:58:41.100643 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [req-0ecfc4a2-4bad-490a-987f-46a8778dbb29 req-c7998fca-792e-46e4-81c4-7e34ab945f34 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171450 Aug 24 06:58:41.104074 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 666/1301] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:58:41.270270 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-0b238f37-8fdd-49fe-b541-5b445396909a tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 204 len: 0 microversion: 2.1 time: 0.343172 Aug 24 06:58:41.273857 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 636/1302] 10.222.0.47 () {58 vars in 1239 bytes} [Wed Aug 24 06:58:40 2022] DELETE /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:58:41.279981 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:41.280587 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:41.287480 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:41.290508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:41.290508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:41.290508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:41.290508 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:41.290914 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:41.434553 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:58:41.442861 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-225f0e41-e73a-4d6f-a770-2407565293da tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.167212 Aug 24 06:58:41.443434 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 667/1303] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:41 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:58:42.467447 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:42.468158 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:42.475386 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:42.475874 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:42.476306 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:42.476994 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:42.477473 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:42.477888 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:42.625853 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.policy [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127728) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:58:42.634091 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-a309de44-6e61-465f-86d1-3a05ad1f8bd6 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1566 microversion: 2.1 time: 0.172615 Aug 24 06:58:42.634667 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 637/1304] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:42 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:58:43.656816 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:43.657454 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:43.664089 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:43.664678 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:43.665032 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:43.665828 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:43.667127 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:43.667852 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:43.809417 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:58:43.818878 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-845bb755-97e4-4efa-a334-2166257804b4 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1448 microversion: 2.1 time: 0.166254 Aug 24 06:58:43.823124 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 668/1305] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:43 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:58:43.913467 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [req-15c966ed-8687-4d9b-a210-e2ae5e06dbc4 req-e2147231-a25f-4864-9ead-e596c2256d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f3238d-9433-4c26-b0f3-6b3699264721", "name": "network-vif-deleted", "tag": "3cbe7c52-b66d-42ce-a944-01967a8d9f64"}]} {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:58:43.923224 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-15c966ed-8687-4d9b-a210-e2ae5e06dbc4 req-e2147231-a25f-4864-9ead-e596c2256d87 service nova] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:43.925731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-15c966ed-8687-4d9b-a210-e2ae5e06dbc4 req-e2147231-a25f-4864-9ead-e596c2256d87 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:43.925731 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [req-15c966ed-8687-4d9b-a210-e2ae5e06dbc4 req-e2147231-a25f-4864-9ead-e596c2256d87 service nova] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:43.935806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.compute.server_external_events [req-15c966ed-8687-4d9b-a210-e2ae5e06dbc4 req-e2147231-a25f-4864-9ead-e596c2256d87 service nova] Creating event network-vif-deleted:3cbe7c52-b66d-42ce-a944-01967a8d9f64 for instance d9f3238d-9433-4c26-b0f3-6b3699264721 on hv-cinder-85427 Aug 24 06:58:43.940800 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [req-15c966ed-8687-4d9b-a210-e2ae5e06dbc4 req-e2147231-a25f-4864-9ead-e596c2256d87 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031159 Aug 24 06:58:43.941691 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 638/1306] 10.222.0.47 () {64 vars in 1317 bytes} [Wed Aug 24 06:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:58:44.841864 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:44.842451 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.compute.api [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127727) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:44.848946 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:44.849453 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:44.849879 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:44.850566 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:44.851003 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:44.851420 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:44.883136 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:44.883599 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:44.884057 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG oslo_concurrency.lockutils [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:44.884493 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.objects.instance [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lazy-loading 'fault' on Instance uuid d9f3238d-9433-4c26-b0f3-6b3699264721 {{(pid=127727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:58:44.929264 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.policy [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e7001705b47a09b6e5d7f08595fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc00174433b49a2980339c2963671b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127727) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:58:44.937726 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-768f808c-0c8f-416b-a959-c965cff61aec tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 200 len: 1223 microversion: 2.1 time: 0.100337 Aug 24 06:58:44.938287 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 669/1307] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:44 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:58:45.960172 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '>' {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:45.960806 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.compute.api [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [instance: d9f3238d-9433-4c26-b0f3-6b3699264721] Fetching instance by UUID {{(pid=127728) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:45.967639 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:45.968112 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:45.968692 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:45.969409 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Acquiring lock "c415c196-7046-4f35-a196-e209a2907be2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:45.969855 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:45.970268 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG oslo_concurrency.lockutils [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Lock "c415c196-7046-4f35-a196-e209a2907be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:45.983826 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.wsgi [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] HTTP exception thrown: Instance d9f3238d-9433-4c26-b0f3-6b3699264721 could not be found. Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Request method failure captured: Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: request: GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 HTTP/1.1 Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept: application/json Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Accept-Encoding: identity Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Connection: close Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Length: 0 Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Content-Type: application/json Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Host: 10.222.0.47 Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Openstack-System-Scope: None Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: User-Agent: python-urllib3/1.26.11 Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Auth-Token: gAAAAABjBcq4OjUf6oxKzBXcAIzIke5M6H7NJaCzAW-G7Zt9sEn6cq6BZdXA03XtSvT5vlsckwCuFDw66BZ739p7xHVwxBq6e1T3CTLjzo3SQ743S-uPFi69texaHa0sSJm0L6Ozg_EXmuIapC3s-M6TA3sv_YUVESXR5-TbjIxPPaIXDL0yFG8 Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Id: None Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Domain-Name: None Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Identity-Status: Confirmed Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Is-Admin-Project: True Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Id: default Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Domain-Name: Default Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Id: 0cc00174433b49a2980339c2963671b0 Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Project-Name: tempest-TestShelveInstance-1714683136 Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Role: reader,member Aug 24 06:58:45.985472 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Roles: reader,member Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0cc00174433b49a2980339c2963671b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0cc00174433b49a2980339c2963671b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0cc00174433b49a2980339c2963671b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0cc00174433b49a2980339c2963671b0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}] Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant: tempest-TestShelveInstance-1714683136 Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Id: 0cc00174433b49a2980339c2963671b0 Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-Tenant-Name: tempest-TestShelveInstance-1714683136 Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User: tempest-TestShelveInstance-1714683136-project Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Id: default Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Domain-Name: Default Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Id: 2e6e7001705b47a09b6e5d7f08595fc8 Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: X-User-Name: tempest-TestShelveInstance-1714683136-project Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: method: > Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: exception: Instance d9f3238d-9433-4c26-b0f3-6b3699264721 could not be found. Aug 24 06:58:45.987262 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: action_args: {'id': 'd9f3238d-9433-4c26-b0f3-6b3699264721'} Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: {{(pid=127728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f3238d-9433-4c26-b0f3-6b3699264721 could not be found. Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:58:45.988533 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f3238d-9433-4c26-b0f3-6b3699264721 could not be found. Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f3238d-9433-4c26-b0f3-6b3699264721 could not be found. Aug 24 06:58:45.990378 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: ERROR nova.api.openstack.wsgi Aug 24 06:58:45.991919 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: DEBUG nova.api.openstack.wsgi [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Returning 404 to user: Instance d9f3238d-9433-4c26-b0f3-6b3699264721 could not be found. {{(pid=127728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:58:45.991919 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO nova.api.openstack.requestlog [None req-627255a4-efc3-404f-9621-25fafb97ad84 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721" status: 404 len: 111 microversion: 2.1 time: 0.031469 Aug 24 06:58:45.991919 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: [pid: 127728|app: 0|req: 639/1308] 10.222.0.47 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:45 2022] GET /compute/v2.1/servers/d9f3238d-9433-4c26-b0f3-6b3699264721 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:58:46.246597 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: DEBUG nova.api.openstack.wsgi [None req-969723e3-02f1-4995-9173-587829b18e38 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] Calling method '.version_select at 0x7fb5d4a10ca0>' {{(pid=127727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:46.251594 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-969723e3-02f1-4995-9173-587829b18e38 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [d0b04d7c-0a96-46e5-aff5-6a112e1d3530] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:58:47.259406 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO oslo.messaging._drivers.impl_rabbit [None req-969723e3-02f1-4995-9173-587829b18e38 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] [d0b04d7c-0a96-46e5-aff5-6a112e1d3530] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 32850. Aug 24 06:58:47.345271 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO nova.api.openstack.requestlog [None req-969723e3-02f1-4995-9173-587829b18e38 tempest-TestShelveInstance-1714683136 tempest-TestShelveInstance-1714683136-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-277619539" status: 202 len: 0 microversion: 2.1 time: 1.102745 Aug 24 06:58:47.345849 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: [pid: 127727|app: 0|req: 670/1309] 10.222.0.47 () {58 vars in 1251 bytes} [Wed Aug 24 06:58:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-277619539 => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:59:11.584237 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:59:11.584890 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Wed Aug 24 06:59:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:59:16.886594 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:59:16.887137 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Wed Aug 24 06:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:00:50.064941 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:00:50.065647 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Wed Aug 24 07:00:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:01:07.812397 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:01:07.813106 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Wed Aug 24 07:01:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:01:25.219094 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:01:25.219694 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Wed Aug 24 07:01:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:02:31.592996 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:02:31.593713 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Wed Aug 24 07:02:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:02:36.895881 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:02:36.896457 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Wed Aug 24 07:02:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:04:04.828434 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:04:04.829261 dv-cinder-854270-1-iscsi devstack@n-api.service[127727]: Wed Aug 24 07:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:04:10.073329 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:04:10.073988 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Wed Aug 24 07:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:04:27.821901 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:04:27.822523 dv-cinder-854270-1-iscsi devstack@n-api.service[127728]: Wed Aug 24 07:04:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!